Aug 17 03:52:53 user nova-compute[72793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 03:52:55 user nova-compute[72793]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72793) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 03:52:55 user nova-compute[72793]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72793) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 03:52:55 user nova-compute[72793]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72793) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 03:52:55 user nova-compute[72793]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 03:52:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:52:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:52:56 user nova-compute[72793]: INFO nova.virt.driver [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 03:52:56 user nova-compute[72793]: INFO nova.compute.provider_config [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Acquiring lock "singleton_lock" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Acquired lock "singleton_lock" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Releasing lock "singleton_lock" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Full set of CONF: {{(pid=72793) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ******************************************************************************** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Configuration options gathered from: {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ================================================================================ {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] allow_resize_to_same_host      = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] arq_binding_timeout            = 300 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] backdoor_port                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] backdoor_socket                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] block_device_allocate_retries  = 300 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] block_device_allocate_retries_interval = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cert                           = self.pem {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute_monitors               = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] config_dir                     = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] config_drive_format            = iso9660 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] config_source                  = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] console_host                   = user {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] control_exchange               = nova {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cpu_allocation_ratio           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] daemon                         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] debug                          = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] default_access_ip_network_name = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] default_availability_zone      = nova {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] default_ephemeral_format       = ext4 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] default_schedule_zone          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] disk_allocation_ratio          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] enable_new_services            = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] enabled_ssl_apis               = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] flat_injected                  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] force_config_drive             = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] force_raw_images               = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] graceful_shutdown_timeout      = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] heal_instance_info_cache_interval = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] host                           = user {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_build_timeout         = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_delete_interval       = 300 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_name_template         = instance-%08x {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_usage_audit           = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_usage_audit_period    = month {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] internal_service_availability_zone = internal {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] key                            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] live_migration_retry_count     = 30 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_config_append              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_dir                        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_file                       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_options                    = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_rotate_interval            = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_rotate_interval_type       = days {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] log_rotation_type              = none {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] long_rpc_timeout               = 1800 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] max_concurrent_builds          = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] max_concurrent_live_migrations = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] max_concurrent_snapshots       = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] max_local_block_devices        = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] max_logfile_count              = 30 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] max_logfile_size_mb            = 200 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] maximum_instance_delete_attempts = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metadata_listen                = 0.0.0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metadata_listen_port           = 8775 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metadata_workers               = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] migrate_max_retries            = -1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] mkisofs_cmd                    = genisoimage {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] my_ip                          = 10.0.0.210 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] network_allocate_retries       = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] osapi_compute_listen_port      = 8774 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] osapi_compute_unique_server_name_scope =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] osapi_compute_workers          = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] password_length                = 12 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] periodic_enable                = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] periodic_fuzzy_delay           = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] pointer_model                  = ps2mouse {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] preallocate_images             = none {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] publish_errors                 = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] pybasedir                      = /opt/stack/nova {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ram_allocation_ratio           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rate_limit_burst               = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rate_limit_except_level        = CRITICAL {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rate_limit_interval            = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reboot_timeout                 = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reclaim_instance_interval      = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] record                         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reimage_timeout_per_gb         = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] report_interval                = 120 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rescue_timeout                 = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reserved_host_cpus             = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reserved_host_disk_mb          = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reserved_host_memory_mb        = 512 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] reserved_huge_pages            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] resize_confirm_window          = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] resize_fs_using_block_device   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] resume_guests_state_on_host_boot = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rpc_response_timeout           = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] run_external_periodic_tasks    = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] running_deleted_instance_action = reap {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] running_deleted_instance_timeout = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler_instance_sync_interval = 120 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_down_time              = 720 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] servicegroup_driver            = db {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] shelved_offload_time           = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] shelved_poll_interval          = 3600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] shutdown_timeout               = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] source_is_ipv6                 = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ssl_only                       = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] state_path                     = /opt/stack/data/nova {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] sync_power_state_interval      = 600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] sync_power_state_pool_size     = 1000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] syslog_log_facility            = LOG_USER {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] tempdir                        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] timeout_nbd                    = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] transport_url                  = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] update_resources_interval      = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_cow_images                 = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_eventlog                   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_journal                    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_json                       = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_rootwrap_daemon            = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_stderr                     = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] use_syslog                     = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vcpu_pin_set                   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plugging_is_fatal          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plugging_timeout           = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] virt_mkfs                      = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] volume_usage_poll_interval     = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] watch_log_file                 = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] web                            = /usr/share/spice-html5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.auth_strategy              = keystone {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.compute_link_prefix        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.dhcp_domain                = novalocal {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.enable_instance_password   = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.glance_link_prefix         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.instance_list_per_project_cells = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.list_records_by_skipping_down_cells = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.local_metadata_per_cell    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.max_limit                  = 1000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.metadata_cache_expiration  = 15 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.neutron_default_tenant_id  = default {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.use_forwarded_for          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.use_neutron_default_nets   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_dynamic_targets = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_jsonfile_path   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.backend_argument         = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.config_prefix            = cache.oslo {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.dead_timeout             = 60.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.debug_cache_backend      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.enable_retry_client      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.enable_socket_keepalive  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.enabled                  = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.expiration_time          = 600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_dead_retry      = 300 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_password        =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_sasl_enabled    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.memcache_username        =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.proxies                  = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.retry_attempts           = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.retry_delay              = 0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.socket_keepalive_count   = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.socket_keepalive_idle    = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.socket_keepalive_interval = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.tls_allowed_ciphers      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.tls_cafile               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.tls_certfile             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.tls_enabled              = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cache.tls_keyfile              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.auth_section            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.auth_type               = password {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.cafile                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.certfile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.collect_timing          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.cross_az_attach         = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.debug                   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.endpoint_template       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.http_retries            = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.insecure                = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.keyfile                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.os_region_name          = RegionOne {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.split_loggers           = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cinder.timeout                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.cpu_dedicated_set      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.cpu_shared_set         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.image_type_exclude_list = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.resource_provider_association_refresh = 300 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.shutdown_retry_interval = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] conductor.workers              = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] console.allowed_origins        = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] console.ssl_ciphers            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] console.ssl_minimum_version    = default {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] consoleauth.token_ttl          = 600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.cafile                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.certfile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.collect_timing          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.connect_retries         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.connect_retry_delay     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.endpoint_override       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.insecure                = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.keyfile                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.max_version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.min_version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.region_name             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.service_name            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.service_type            = accelerator {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.split_loggers           = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.status_code_retries     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.timeout                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] cyborg.version                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.backend               = sqlalchemy {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.connection            = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.connection_debug      = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.connection_parameters =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.connection_recycle_time = 3600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.connection_trace      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.db_inc_retry_interval = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.db_max_retries        = 20 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.db_max_retry_interval = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.db_retry_interval     = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.max_overflow          = 50 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.max_pool_size         = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.max_retries           = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.mysql_enable_ndb      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.pool_timeout          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.retry_interval        = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.slave_connection      = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] database.sqlite_synchronous    = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.backend           = sqlalchemy {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.connection        = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.connection_debug  = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.connection_parameters =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.connection_recycle_time = 3600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.connection_trace  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.db_inc_retry_interval = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.db_max_retries    = 20 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.db_max_retry_interval = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.db_retry_interval = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.max_overflow      = 50 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.max_pool_size     = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.max_retries       = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.mysql_enable_ndb  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.pool_timeout      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.retry_interval    = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.slave_connection  = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] api_database.sqlite_synchronous = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] devices.enabled_mdev_types     = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ephemeral_storage_encryption.enabled = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.api_servers             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.cafile                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.certfile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.collect_timing          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.connect_retries         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.connect_retry_delay     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.debug                   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.default_trusted_certificate_ids = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.enable_certificate_validation = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.enable_rbd_download     = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.endpoint_override       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.insecure                = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.keyfile                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.max_version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.min_version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.num_retries             = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.rbd_ceph_conf           =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.rbd_connect_timeout     = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.rbd_pool                =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.rbd_user                =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.region_name             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.service_name            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.service_type            = image {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.split_loggers           = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.status_code_retries     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.timeout                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.verify_glance_signatures = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] glance.version                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] guestfs.debug                  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.config_drive_cdrom      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.config_drive_inject_password = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.enable_remotefx         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.instances_path_share    =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.limit_cpu_features      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.use_multipath_io        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.vswitch_name            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] mks.enabled                    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] image_cache.manager_interval   = 2400 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] image_cache.precache_concurrency = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] image_cache.remove_unused_base_images = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] image_cache.subdirectory_name  = _base {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.api_max_retries         = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.api_retry_interval      = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.auth_section            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.auth_type               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.cafile                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.certfile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.collect_timing          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.connect_retries         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.connect_retry_delay     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.endpoint_override       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.insecure                = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.keyfile                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.max_version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.min_version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.partition_key           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.peer_list               = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.region_name             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.serial_console_state_timeout = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.service_name            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.service_type            = baremetal {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.split_loggers           = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.status_code_retries     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.timeout                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ironic.version                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] key_manager.fixed_key          = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.barbican_api_version  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.barbican_endpoint     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.barbican_endpoint_type = public {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.barbican_region_name  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.cafile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.certfile              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.collect_timing        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.insecure              = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.keyfile               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.number_of_retries     = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.retry_delay           = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.send_service_user_token = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.split_loggers         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.timeout               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.verify_ssl            = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican.verify_ssl_path       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.auth_section = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.auth_type = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.cafile   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.certfile = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.collect_timing = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.insecure = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.keyfile  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.split_loggers = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] barbican_service_user.timeout  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.approle_role_id          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.approle_secret_id        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.cafile                   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.certfile                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.collect_timing           = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.insecure                 = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.keyfile                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.kv_mountpoint            = secret {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.kv_version               = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.namespace                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.root_token_id            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.split_loggers            = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.ssl_ca_crt_file          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.timeout                  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.use_ssl                  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.cafile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.certfile              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.collect_timing        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.connect_retries       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.connect_retry_delay   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.endpoint_override     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.insecure              = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.keyfile               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.max_version           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.min_version           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.region_name           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.service_name          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.service_type          = identity {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.split_loggers         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.status_code_retries   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.timeout               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] keystone.version               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.connection_uri         =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_mode               = custom {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: WARNING oslo_config.cfg [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_power_governor_high = performance {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_power_management   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.device_detach_attempts = 8 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.device_detach_timeout  = 20 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.disk_cachemodes        = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.disk_prefix            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.enabled_perf_events    = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.file_backed_memory     = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.gid_maps               = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.hw_disk_discard        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.hw_machine_type        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_rbd_pool        = rbd {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_type            = default {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.images_volume_group    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.inject_key             = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.inject_partition       = -2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.inject_password        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.iscsi_iface            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.iser_use_multipath     = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_downtime = 500 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_inbound_addr = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_scheme  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_timeout_action = abort {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_tunnelled = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: WARNING oslo_config.cfg [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 03:52:56 user nova-compute[72793]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 03:52:56 user nova-compute[72793]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 03:52:56 user nova-compute[72793]: and ``live_migration_inbound_addr`` respectively.
Aug 17 03:52:56 user nova-compute[72793]: ).  Its value may be silently ignored in the future.
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.live_migration_with_native_tls = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.max_queues             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.nfs_mount_options      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.num_pcie_ports         = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.pmem_namespaces        = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.quobyte_client_cfg     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rbd_secret_uuid        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rbd_user               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rescue_image_id        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rescue_kernel_id       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.rx_queue_size          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.smbfs_mount_options    =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.snapshot_compression   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.snapshot_image_format  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.sparse_logical_volumes = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.swtpm_enabled          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.swtpm_group            = tss {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.swtpm_user             = tss {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.sysinfo_serial         = unique {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.tb_cache_size          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.tx_queue_size          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.uid_maps               = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.use_virtio_for_bridges = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.virt_type              = kvm {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.volume_clear           = zero {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.volume_clear_size      = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.volume_use_multipath   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_cache_path   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.auth_section           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.auth_type              = password {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.cafile                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.certfile               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.collect_timing         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.connect_retries        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.connect_retry_delay    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.default_floating_pool  = public {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.endpoint_override      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.extension_sync_interval = 600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.http_retries           = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.insecure               = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.keyfile                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.max_version            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.min_version            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.ovs_bridge             = br-int {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.physnets               = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.region_name            = RegionOne {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.service_metadata_proxy = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.service_name           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.service_type           = network {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.split_loggers          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.status_code_retries    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.timeout                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] neutron.version                = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] notifications.bdms_in_notifications = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] notifications.default_level    = INFO {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] notifications.notification_format = unversioned {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] notifications.notify_on_state_change = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] pci.alias                      = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] pci.device_spec                = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] pci.report_in_placement        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.auth_section         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.auth_type            = password {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.cafile               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.certfile             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.collect_timing       = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.connect_retries      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.connect_retry_delay  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.default_domain_id    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.default_domain_name  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.domain_id            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.domain_name          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.endpoint_override    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.insecure             = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.keyfile              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.max_version          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.min_version          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.password             = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.project_domain_id    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.project_domain_name  = Default {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.project_id           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.project_name         = service {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.region_name          = RegionOne {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.service_name         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.service_type         = placement {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.split_loggers        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.status_code_retries  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.system_scope         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.timeout              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.trust_id             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.user_domain_id       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.user_domain_name     = Default {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.user_id              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.username             = placement {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] placement.version              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.cores                    = 20 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.count_usage_from_placement = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.injected_file_content_bytes = 10240 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.injected_file_path_length = 255 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.injected_files           = 5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.instances                = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.key_pairs                = 100 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.metadata_items           = 128 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.ram                      = 51200 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.recheck_quota            = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.server_group_members     = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] quota.server_groups            = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rdp.enabled                    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.image_metadata_prefilter = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.max_attempts         = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.max_placement_results = 1000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] scheduler.workers              = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.host_subset_size = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.isolated_hosts = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.isolated_images = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.pci_in_placement = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.track_instance_changes = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metrics.required               = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metrics.weight_multiplier      = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] metrics.weight_setting         = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] serial_console.enabled         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] serial_console.port_range      = 10000:20000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] serial_console.serialproxy_port = 6083 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.auth_section      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.auth_type         = password {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.cafile            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.certfile          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.collect_timing    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.insecure          = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.keyfile           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.send_service_user_token = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.split_loggers     = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] service_user.timeout           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.agent_enabled            = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.enabled                  = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.html5proxy_port          = 6082 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.image_compression        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.jpeg_compression         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.playback_compression     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.server_listen            = 127.0.0.1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.streaming_mode           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] spice.zlib_compression         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] upgrade_levels.baseapi         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] upgrade_levels.cert            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] upgrade_levels.compute         = auto {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] upgrade_levels.conductor       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] upgrade_levels.scheduler       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.cafile = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.certfile = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.insecure = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vendordata_dynamic_auth.timeout = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.api_retry_count         = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.ca_file                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.cache_prefix            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.cluster_name            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.connection_pool_size    = 10 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.console_delay_seconds   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.datastore_regex         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.host_ip                 = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.host_password           = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.host_port               = 443 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.host_username           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.insecure                = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.integration_bridge      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.maximum_objects         = 100 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.pbm_default_policy      = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.pbm_enabled             = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.pbm_wsdl_location       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.serial_port_proxy_uri   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.serial_port_service_uri = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.task_poll_interval      = 0.5 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.use_linked_clone        = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.vnc_keymap              = en-us {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.vnc_port                = 5900 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vmware.vnc_port_total          = 10000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.auth_schemes               = ['none'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.enabled                    = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.novncproxy_port            = 6080 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.vencrypt_ca_certs          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.vencrypt_client_cert       = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vnc.vencrypt_client_key        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.disable_rootwrap   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.enable_numa_live_migration = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.libvirt_disable_apic = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.client_socket_timeout     = 900 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.default_pool_size         = 1000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.keep_alive                = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.max_header_line           = 16384 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.ssl_ca_file               = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.ssl_cert_file             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.ssl_key_file              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.tcp_keepidle              = 600 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] zvm.ca_file                    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] zvm.cloud_connector_url        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] zvm.reachable_timeout          = 300 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.enforce_new_defaults = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.enforce_scope      = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.policy_default_rule = default {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.connection_string     = messaging:// {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.enabled               = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.es_doc_type           = notification {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.es_scroll_size        = 10000 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.es_scroll_time        = 2m {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.filter_error_trace    = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.hmac_keys             = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.sentinel_service_name = mymaster {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.socket_timeout        = 0.1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.trace_requests        = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler.trace_sqlalchemy      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler_jaeger.process_tags   = {} {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] profiler_otlp.service_name_prefix = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] remote_debug.host              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] remote_debug.port              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.auth_section        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.auth_type           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.cafile              = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.certfile            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.collect_timing      = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.connect_retries     = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.connect_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.endpoint_id         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.endpoint_override   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.insecure            = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.keyfile             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.max_version         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.min_version         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.region_name         = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.service_name        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.service_type        = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.split_loggers       = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.status_code_retries = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.status_code_retry_delay = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.timeout             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.valid_interfaces    = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_limit.version             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_reports.file_event_handler = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] oslo_reports.log_dir           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_ovs_privileged.group  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] vif_plug_ovs_privileged.user   = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_ovs.isolate_vif         = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] os_brick.lock_path             = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] privsep_osbrick.capabilities   = [21] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] privsep_osbrick.group          = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] privsep_osbrick.helper_command = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] privsep_osbrick.user           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] nova_sys_admin.group           = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] nova_sys_admin.helper_command  = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] nova_sys_admin.user            = None {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG oslo_service.service [None req-89881c26-0c41-4be9-baac-b6c0229895a3 None None] ******************************************************************************** {{(pid=72793) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 03:52:56 user nova-compute[72793]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Starting native event thread {{(pid=72793) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Starting green dispatch thread {{(pid=72793) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Starting connection event dispatch thread {{(pid=72793) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Connecting to libvirt: qemu:///system {{(pid=72793) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f98f49a4f40> {{(pid=72793) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f98f49a4f40> {{(pid=72793) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 03:52:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Connection event '1' reason 'None'
Aug 17 03:52:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 03:52:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.mount [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Initialising _HostMountState generation 0 {{(pid=72793) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 03:53:03 user nova-compute[72793]: INFO nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host capabilities <capabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <host>
Aug 17 03:53:03 user nova-compute[72793]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 03:53:03 user nova-compute[72793]:     <cpu>
Aug 17 03:53:03 user nova-compute[72793]:       <arch>x86_64</arch>
Aug 17 03:53:03 user nova-compute[72793]:       <model>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <microcode version='1070'/>
Aug 17 03:53:03 user nova-compute[72793]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='osxsave'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='invtsc'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='rsba'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 03:53:03 user nova-compute[72793]:       <pages unit='KiB' size='4'/>
Aug 17 03:53:03 user nova-compute[72793]:       <pages unit='KiB' size='2048'/>
Aug 17 03:53:03 user nova-compute[72793]:     </cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <power_management>
Aug 17 03:53:03 user nova-compute[72793]:       <suspend_mem/>
Aug 17 03:53:03 user nova-compute[72793]:       <suspend_disk/>
Aug 17 03:53:03 user nova-compute[72793]:       <suspend_hybrid/>
Aug 17 03:53:03 user nova-compute[72793]:     </power_management>
Aug 17 03:53:03 user nova-compute[72793]:     <iommu support='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <migration_features>
Aug 17 03:53:03 user nova-compute[72793]:       <live/>
Aug 17 03:53:03 user nova-compute[72793]:       <uri_transports>
Aug 17 03:53:03 user nova-compute[72793]:         <uri_transport>tcp</uri_transport>
Aug 17 03:53:03 user nova-compute[72793]:         <uri_transport>rdma</uri_transport>
Aug 17 03:53:03 user nova-compute[72793]:       </uri_transports>
Aug 17 03:53:03 user nova-compute[72793]:     </migration_features>
Aug 17 03:53:03 user nova-compute[72793]:     <topology>
Aug 17 03:53:03 user nova-compute[72793]:       <cells num='2'>
Aug 17 03:53:03 user nova-compute[72793]:         <cell id='0'>
Aug 17 03:53:03 user nova-compute[72793]:           <memory unit='KiB'>8189224</memory>
Aug 17 03:53:03 user nova-compute[72793]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 17 03:53:03 user nova-compute[72793]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 03:53:03 user nova-compute[72793]:           <distances>
Aug 17 03:53:03 user nova-compute[72793]:             <sibling id='0' value='10'/>
Aug 17 03:53:03 user nova-compute[72793]:             <sibling id='1' value='20'/>
Aug 17 03:53:03 user nova-compute[72793]:           </distances>
Aug 17 03:53:03 user nova-compute[72793]:           <cpus num='6'>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 03:53:03 user nova-compute[72793]:           </cpus>
Aug 17 03:53:03 user nova-compute[72793]:         </cell>
Aug 17 03:53:03 user nova-compute[72793]:         <cell id='1'>
Aug 17 03:53:03 user nova-compute[72793]:           <memory unit='KiB'>8206460</memory>
Aug 17 03:53:03 user nova-compute[72793]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 17 03:53:03 user nova-compute[72793]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 03:53:03 user nova-compute[72793]:           <distances>
Aug 17 03:53:03 user nova-compute[72793]:             <sibling id='0' value='20'/>
Aug 17 03:53:03 user nova-compute[72793]:             <sibling id='1' value='10'/>
Aug 17 03:53:03 user nova-compute[72793]:           </distances>
Aug 17 03:53:03 user nova-compute[72793]:           <cpus num='6'>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 03:53:03 user nova-compute[72793]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 03:53:03 user nova-compute[72793]:           </cpus>
Aug 17 03:53:03 user nova-compute[72793]:         </cell>
Aug 17 03:53:03 user nova-compute[72793]:       </cells>
Aug 17 03:53:03 user nova-compute[72793]:     </topology>
Aug 17 03:53:03 user nova-compute[72793]:     <cache>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 03:53:03 user nova-compute[72793]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 03:53:03 user nova-compute[72793]:     </cache>
Aug 17 03:53:03 user nova-compute[72793]:     <secmodel>
Aug 17 03:53:03 user nova-compute[72793]:       <model>apparmor</model>
Aug 17 03:53:03 user nova-compute[72793]:       <doi>0</doi>
Aug 17 03:53:03 user nova-compute[72793]:     </secmodel>
Aug 17 03:53:03 user nova-compute[72793]:     <secmodel>
Aug 17 03:53:03 user nova-compute[72793]:       <model>dac</model>
Aug 17 03:53:03 user nova-compute[72793]:       <doi>0</doi>
Aug 17 03:53:03 user nova-compute[72793]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 03:53:03 user nova-compute[72793]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 03:53:03 user nova-compute[72793]:     </secmodel>
Aug 17 03:53:03 user nova-compute[72793]:   </host>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='alpha'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>clipper</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='armv6l'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>spitz</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>nuri</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>kzm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sx1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>z2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>tosa</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>n810</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>n800</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>terrier</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>midway</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>microbit</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>verdex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>highbank</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>akita</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>connex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>collie</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='armv7l'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>spitz</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>nuri</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>kzm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sx1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>z2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>tosa</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>n810</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>n800</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>terrier</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>midway</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>microbit</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>verdex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>highbank</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>akita</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>connex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>collie</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='aarch64'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>spitz</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>nuri</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>kzm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sx1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>z2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>tosa</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>n810</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>n800</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>terrier</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>midway</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>microbit</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>verdex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>highbank</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>akita</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>connex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>collie</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <acpi default='on' toggle='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='cris'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='i686'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>isapc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>microvm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='kvm'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <pae/>
Aug 17 03:53:03 user nova-compute[72793]:       <nonpae/>
Aug 17 03:53:03 user nova-compute[72793]:       <acpi default='on' toggle='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:       <apic default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='m68k'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>an5206</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>q800</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='microblaze'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='microblazeel'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='mips'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='16'>malta</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='mipsel'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='16'>malta</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='mips64'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='16'>malta</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>pica61</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>magnum</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='mips64el'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='16'>malta</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>pica61</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>magnum</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='16'>boston</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='ppc'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mac99</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>40p</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>taihu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='ppc64'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>taihu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>40p</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mac99</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='ppc64le'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>taihu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>40p</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>mac99</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='riscv32'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='8'>spike</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='8'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='riscv64'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='8'>spike</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='8'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='s390x'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='sh4'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>shix</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>r2d</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='sh4eb'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>shix</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>r2d</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='sparc'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>LX</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='sparc64'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>niagara</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='x86_64'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>64</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='1'>isapc</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>microvm</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='kvm'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <acpi default='on' toggle='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:       <apic default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='xtensa'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>sim</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>kc705</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ml605</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx200</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx60</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]:   <guest>
Aug 17 03:53:03 user nova-compute[72793]:     <os_type>hvm</os_type>
Aug 17 03:53:03 user nova-compute[72793]:     <arch name='xtensaeb'>
Aug 17 03:53:03 user nova-compute[72793]:       <wordsize>32</wordsize>
Aug 17 03:53:03 user nova-compute[72793]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='4'>sim</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>kc705</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ml605</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>virt</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx200</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>lx60</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 03:53:03 user nova-compute[72793]:       <domain type='qemu'/>
Aug 17 03:53:03 user nova-compute[72793]:     </arch>
Aug 17 03:53:03 user nova-compute[72793]:     <features>
Aug 17 03:53:03 user nova-compute[72793]:       <cpuselection/>
Aug 17 03:53:03 user nova-compute[72793]:       <deviceboot/>
Aug 17 03:53:03 user nova-compute[72793]:       <disksnapshot default='on' toggle='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     </features>
Aug 17 03:53:03 user nova-compute[72793]:   </guest>
Aug 17 03:53:03 user nova-compute[72793]: </capabilities>
Aug 17 03:53:03 user nova-compute[72793]: 
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-i440fx-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>i686</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='255'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'/>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='lm'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ide</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-q35-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>i686</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='288'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'/>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='lm'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-q35-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>i686</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='288'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'/>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='lm'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-i440fx-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>i686</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='255'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'/>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='lm'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ide</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-i440fx-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>x86_64</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='255'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>efi</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='invtsc'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='rsba'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ide</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-q35-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>x86_64</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='288'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>efi</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='invtsc'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='rsba'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-q35-6.2</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>x86_64</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='288'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>efi</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='invtsc'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='rsba'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 03:53:03 user nova-compute[72793]: <domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 03:53:03 user nova-compute[72793]:   <domain>kvm</domain>
Aug 17 03:53:03 user nova-compute[72793]:   <machine>pc-i440fx-jammy</machine>
Aug 17 03:53:03 user nova-compute[72793]:   <arch>x86_64</arch>
Aug 17 03:53:03 user nova-compute[72793]:   <vcpu max='255'/>
Aug 17 03:53:03 user nova-compute[72793]:   <iothreads supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:   <os supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='firmware'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>efi</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:     <loader supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>rom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pflash</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='readonly'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>yes</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='secure'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>no</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </loader>
Aug 17 03:53:03 user nova-compute[72793]:   </os>
Aug 17 03:53:03 user nova-compute[72793]:   <cpu>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-passthrough' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='hostPassthroughMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='maximum' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='maximumMigratable'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>on</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>off</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='host-model' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <vendor>Intel</vendor>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ss'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='vmx'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pcid'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='hypervisor'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arat'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='umip'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='md-clear'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='invtsc'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibpb'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='ibrs'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-stibp'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='rsba'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='erms'/>
Aug 17 03:53:03 user nova-compute[72793]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:     <mode name='custom' supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>qemu64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>qemu32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>phenom</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>pentium</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>n270</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm64</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>kvm32</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>coreduo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>core2duo</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>athlon</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Westmere</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Snowridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Skylake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>SandyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Penryn</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G5</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G4</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G3</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Opteron_G2</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Opteron_G1</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>IvyBridge</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Icelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Haswell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Rome</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-Milan</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>EPYC</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Dhyana</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cooperlake</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>Conroe</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='no'>Broadwell</model>
Aug 17 03:53:03 user nova-compute[72793]:       <model usable='yes'>486</model>
Aug 17 03:53:03 user nova-compute[72793]:     </mode>
Aug 17 03:53:03 user nova-compute[72793]:   </cpu>
Aug 17 03:53:03 user nova-compute[72793]:   <memoryBacking supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:     <enum name='sourceType'>
Aug 17 03:53:03 user nova-compute[72793]:       <value>file</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>anonymous</value>
Aug 17 03:53:03 user nova-compute[72793]:       <value>memfd</value>
Aug 17 03:53:03 user nova-compute[72793]:     </enum>
Aug 17 03:53:03 user nova-compute[72793]:   </memoryBacking>
Aug 17 03:53:03 user nova-compute[72793]:   <devices>
Aug 17 03:53:03 user nova-compute[72793]:     <disk supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='diskDevice'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>disk</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cdrom</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>floppy</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>lun</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='bus'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ide</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>fdc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sata</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </disk>
Aug 17 03:53:03 user nova-compute[72793]:     <graphics supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='type'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>sdl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vnc</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>spice</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egl-headless</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </graphics>
Aug 17 03:53:03 user nova-compute[72793]:     <video supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='modelType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>cirrus</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>vmvga</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>qxl</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>none</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>bochs</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>ramfb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </video>
Aug 17 03:53:03 user nova-compute[72793]:     <hostdev supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='mode'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>subsystem</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='startupPolicy'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>default</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>mandatory</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>requisite</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>optional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='subsysType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>usb</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>pci</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>scsi</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='capsType'/>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='pciBackend'/>
Aug 17 03:53:03 user nova-compute[72793]:     </hostdev>
Aug 17 03:53:03 user nova-compute[72793]:     <rng supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtio-non-transitional</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>random</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>egd</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>builtin</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </rng>
Aug 17 03:53:03 user nova-compute[72793]:     <filesystem supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='driverType'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>path</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>handle</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>virtiofs</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </filesystem>
Aug 17 03:53:03 user nova-compute[72793]:     <tpm supported='yes'>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='model'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-tis</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>tpm-crb</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:       <enum name='backendModel'>
Aug 17 03:53:03 user nova-compute[72793]:         <value>passthrough</value>
Aug 17 03:53:03 user nova-compute[72793]:         <value>emulator</value>
Aug 17 03:53:03 user nova-compute[72793]:       </enum>
Aug 17 03:53:03 user nova-compute[72793]:     </tpm>
Aug 17 03:53:03 user nova-compute[72793]:   </devices>
Aug 17 03:53:03 user nova-compute[72793]:   <features>
Aug 17 03:53:03 user nova-compute[72793]:     <gic supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:     <vmcoreinfo supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <genid supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backingStoreInput supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <backup supported='yes'/>
Aug 17 03:53:03 user nova-compute[72793]:     <sev supported='no'/>
Aug 17 03:53:03 user nova-compute[72793]:   </features>
Aug 17 03:53:03 user nova-compute[72793]: </domainCapabilities>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72793) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72793) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Checking secure boot support for host arch (x86_64) {{(pid=72793) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Checking secure boot support for host arch (x86_64) {{(pid=72793) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Checking secure boot support for host arch (x86_64) {{(pid=72793) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 03:53:03 user nova-compute[72793]: INFO nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Secure Boot support detected
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] cpu compare xml: <cpu match="exact">
Aug 17 03:53:03 user nova-compute[72793]:   <model>Nehalem</model>
Aug 17 03:53:03 user nova-compute[72793]: </cpu>
Aug 17 03:53:03 user nova-compute[72793]:  {{(pid=72793) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 03:53:03 user nova-compute[72793]: INFO nova.virt.node [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Generated node identity ef0e298c-f5d0-48e3-afdd-0063943a3710
Aug 17 03:53:03 user nova-compute[72793]: INFO nova.virt.node [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Wrote node identity ef0e298c-f5d0-48e3-afdd-0063943a3710 to /opt/stack/data/nova/compute_id
Aug 17 03:53:03 user nova-compute[72793]: WARNING nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Compute nodes ['ef0e298c-f5d0-48e3-afdd-0063943a3710'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 03:53:03 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 03:53:03 user nova-compute[72793]: WARNING nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 03:53:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:53:03 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:53:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:53:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Hypervisor/Node resource view: name=user free_ram=10839MB free_disk=26.410717010498047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:53:04 user nova-compute[72793]: WARNING nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] No compute node record for user:ef0e298c-f5d0-48e3-afdd-0063943a3710: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ef0e298c-f5d0-48e3-afdd-0063943a3710 could not be found.
Aug 17 03:53:04 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Compute node record created for user:user with uuid: ef0e298c-f5d0-48e3-afdd-0063943a3710
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:53:04 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [req-16c61e91-a815-4bcc-8c6b-4137c81f1130] Created resource provider record via placement API for resource provider with UUID ef0e298c-f5d0-48e3-afdd-0063943a3710 and name user.
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72793) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 03:53:04 user nova-compute[72793]: INFO nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] kernel doesn't support AMD SEV
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Libvirt baseline CPU <cpu>
Aug 17 03:53:04 user nova-compute[72793]:   <arch>x86_64</arch>
Aug 17 03:53:04 user nova-compute[72793]:   <model>Nehalem</model>
Aug 17 03:53:04 user nova-compute[72793]:   <vendor>Intel</vendor>
Aug 17 03:53:04 user nova-compute[72793]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 03:53:04 user nova-compute[72793]: </cpu>
Aug 17 03:53:04 user nova-compute[72793]:  {{(pid=72793) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Updated inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Updating resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 generation from 0 to 1 during operation: update_inventory {{(pid=72793) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Updating resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 generation from 1 to 2 during operation: update_traits {{(pid=72793) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.service [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Creating RPC server for service compute {{(pid=72793) start /opt/stack/nova/nova/service.py:182}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.service [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Join ServiceGroup membership for this service compute {{(pid=72793) start /opt/stack/nova/nova/service.py:199}}
Aug 17 03:53:04 user nova-compute[72793]: DEBUG nova.servicegroup.drivers.db [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72793) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 03:53:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 03:53:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:53:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:53:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=10196MB free_disk=26.31442642211914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:53:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:54:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:54:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=10177MB free_disk=26.360698699951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:54:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 03:55:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 03:55:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:55:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:55:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=10206MB free_disk=26.14474105834961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:55:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 03:55:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:55:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 03:56:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:56:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:56:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=9472MB free_disk=26.176048278808594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:56:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:56:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:56:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 03:57:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:57:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:57:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:09 user nova-compute[72793]: INFO nova.compute.claims [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Claim successful on node user
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Creating image(s)
Aug 17 03:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "/opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "/opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "/opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG nova.policy [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd095effb4184494d8208d699503518e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdafd60dcec74aa1a0c0b01a5a583a89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.part --force-share --output=json" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG nova.virt.images [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] 5f4b4804-03ee-46d6-a29f-d5a8a50dfc98 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.part /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.part /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.converted" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.102s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:11 user nova-compute[72793]: INFO oslo.privsep.daemon [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprbjk6kfm/privsep.sock']
Aug 17 03:57:11 user sudo[82303]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprbjk6kfm/privsep.sock
Aug 17 03:57:11 user sudo[82303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:12 user nova-compute[72793]: INFO nova.compute.claims [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Claim successful on node user
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:12 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:12 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Creating image(s)
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG nova.policy [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad95533bd5634f7384f9c9f58a9aaf81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b799dd936be46aab2513974c488ae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Successfully created port: df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:13 user sudo[82303]: pam_unix(sudo:session): session closed for user root
Aug 17 03:57:13 user nova-compute[72793]: INFO oslo.privsep.daemon [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Spawned new privsep daemon via rootwrap
Aug 17 03:57:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 03:57:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 03:57:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 03:57:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82307
Aug 17 03:57:13 user nova-compute[72793]: WARNING oslo_privsep.priv_context [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] privsep daemon already running
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.016s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.253s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.160s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk 1073741824" returned: 0 in 0.046s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.209s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.169s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.239s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk 1073741824" returned: 0 in 0.074s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Cannot resize image /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lazy-loading 'migration_context' on Instance uuid af93423f-79c3-4f93-89ca-32be3c13f74f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Ensure instance console log exists: /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.169s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Cannot resize image /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'migration_context' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Ensure instance console log exists: /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:16 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Successfully created port: fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Successfully updated port: df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquired lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-changed-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Refreshing instance network info cache due to event network-changed-df034dbc-5143-41fb-8ed9-44afac950ce8. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] Acquiring lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updating instance_info_cache with network_info: [{"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Releasing lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Instance network_info: |[{"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] Acquired lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.neutron [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Refreshing network info cache for port df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Start _get_guest_xml network_info=[{"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-868964321',display_name='tempest-DeleteServersTestJSON-server-868964321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-868964321',id=1,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdafd60dcec74aa1a0c0b01a5a583a89',ramdisk_id='',reservation_id='r-om04jbnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1235844610',owner_user_name='tempest-DeleteServersTestJSON-1235844610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:11Z,user_data=None,user_id='d095effb4184494d8208d699503518e3',uuid=af93423f-79c3-4f93-89ca-32be3c13f74f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Converting VIF {"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.objects.instance [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lazy-loading 'pci_devices' on Instance uuid af93423f-79c3-4f93-89ca-32be3c13f74f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:19 user nova-compute[72793]:   <uuid>af93423f-79c3-4f93-89ca-32be3c13f74f</uuid>
Aug 17 03:57:19 user nova-compute[72793]:   <name>instance-00000001</name>
Aug 17 03:57:19 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:19 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:19 user nova-compute[72793]:   <metadata>
Aug 17 03:57:19 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:19 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:19 user nova-compute[72793]:       <nova:name>tempest-DeleteServersTestJSON-server-868964321</nova:name>
Aug 17 03:57:19 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:19</nova:creationTime>
Aug 17 03:57:19 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:19 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:19 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:19 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:user uuid="d095effb4184494d8208d699503518e3">tempest-DeleteServersTestJSON-1235844610-project-member</nova:user>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:project uuid="bdafd60dcec74aa1a0c0b01a5a583a89">tempest-DeleteServersTestJSON-1235844610</nova:project>
Aug 17 03:57:19 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:19 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:19 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:19 user nova-compute[72793]:         <nova:port uuid="df034dbc-5143-41fb-8ed9-44afac950ce8">
Aug 17 03:57:19 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 03:57:19 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:19 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:19 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:19 user nova-compute[72793]:   </metadata>
Aug 17 03:57:19 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:19 user nova-compute[72793]:     <system>
Aug 17 03:57:19 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:19 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:19 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:19 user nova-compute[72793]:       <entry name="serial">af93423f-79c3-4f93-89ca-32be3c13f74f</entry>
Aug 17 03:57:19 user nova-compute[72793]:       <entry name="uuid">af93423f-79c3-4f93-89ca-32be3c13f74f</entry>
Aug 17 03:57:19 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:19 user nova-compute[72793]:     </system>
Aug 17 03:57:19 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:19 user nova-compute[72793]:   <os>
Aug 17 03:57:19 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:19 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:19 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:19 user nova-compute[72793]:   </os>
Aug 17 03:57:19 user nova-compute[72793]:   <features>
Aug 17 03:57:19 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:19 user nova-compute[72793]:     <apic/>
Aug 17 03:57:19 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:19 user nova-compute[72793]:   </features>
Aug 17 03:57:19 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:19 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:19 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:19 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:19 user nova-compute[72793]:   </clock>
Aug 17 03:57:19 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:19 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:19 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:19 user nova-compute[72793]:   </cpu>
Aug 17 03:57:19 user nova-compute[72793]:   <devices>
Aug 17 03:57:19 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:19 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:19 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk"/>
Aug 17 03:57:19 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:19 user nova-compute[72793]:     </disk>
Aug 17 03:57:19 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:19 user nova-compute[72793]:       <mac address="fa:16:3e:8f:d6:75"/>
Aug 17 03:57:19 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:19 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:19 user nova-compute[72793]:       <target dev="tapdf034dbc-51"/>
Aug 17 03:57:19 user nova-compute[72793]:     </interface>
Aug 17 03:57:19 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:19 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/console.log" append="off"/>
Aug 17 03:57:19 user nova-compute[72793]:     </serial>
Aug 17 03:57:19 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:19 user nova-compute[72793]:     <video>
Aug 17 03:57:19 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:19 user nova-compute[72793]:     </video>
Aug 17 03:57:19 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:19 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:19 user nova-compute[72793]:     </rng>
Aug 17 03:57:19 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:19 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:19 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:19 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:19 user nova-compute[72793]:   </devices>
Aug 17 03:57:19 user nova-compute[72793]: </domain>
Aug 17 03:57:19 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-868964321',display_name='tempest-DeleteServersTestJSON-server-868964321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-868964321',id=1,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdafd60dcec74aa1a0c0b01a5a583a89',ramdisk_id='',reservation_id='r-om04jbnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1235844610',owner_user_name='tempest-DeleteServersTestJSON-1235844610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:11Z,user_data=None,user_id='d095effb4184494d8208d699503518e3',uuid=af93423f-79c3-4f93-89ca-32be3c13f74f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Converting VIF {"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG os_vif [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Created schema index Interface.name {{(pid=72793) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Created schema index Port.name {{(pid=72793) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Created schema index Bridge.name {{(pid=72793) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [POLLOUT] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:19 user nova-compute[72793]: INFO oslo.privsep.daemon [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpq_jbr0at/privsep.sock']
Aug 17 03:57:19 user sudo[82373]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpq_jbr0at/privsep.sock
Aug 17 03:57:19 user sudo[82373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 03:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Successfully updated port: fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-changed-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Refreshing instance network info cache due to event network-changed-fcf0e2da-57d4-4b11-8d5d-4410979612d7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance network_info: |[{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.network.neutron [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Refreshing network info cache for port fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start _get_guest_xml network_info=[{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'pci_devices' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:21 user nova-compute[72793]:   <uuid>07328c90-993b-4b0c-8673-04c850aae29c</uuid>
Aug 17 03:57:21 user nova-compute[72793]:   <name>instance-00000002</name>
Aug 17 03:57:21 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:21 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:21 user nova-compute[72793]:   <metadata>
Aug 17 03:57:21 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:21 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:21 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherB-server-276616593</nova:name>
Aug 17 03:57:21 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:20</nova:creationTime>
Aug 17 03:57:21 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:21 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:21 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:21 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:user uuid="ad95533bd5634f7384f9c9f58a9aaf81">tempest-ServerActionsTestOtherB-1791175768-project-member</nova:user>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:project uuid="5b799dd936be46aab2513974c488ae92">tempest-ServerActionsTestOtherB-1791175768</nova:project>
Aug 17 03:57:21 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:21 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:21 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:21 user nova-compute[72793]:         <nova:port uuid="fcf0e2da-57d4-4b11-8d5d-4410979612d7">
Aug 17 03:57:21 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 03:57:21 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:21 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:21 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:21 user nova-compute[72793]:   </metadata>
Aug 17 03:57:21 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:21 user nova-compute[72793]:     <system>
Aug 17 03:57:21 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:21 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:21 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:21 user nova-compute[72793]:       <entry name="serial">07328c90-993b-4b0c-8673-04c850aae29c</entry>
Aug 17 03:57:21 user nova-compute[72793]:       <entry name="uuid">07328c90-993b-4b0c-8673-04c850aae29c</entry>
Aug 17 03:57:21 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:21 user nova-compute[72793]:     </system>
Aug 17 03:57:21 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:21 user nova-compute[72793]:   <os>
Aug 17 03:57:21 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:21 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:21 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:21 user nova-compute[72793]:   </os>
Aug 17 03:57:21 user nova-compute[72793]:   <features>
Aug 17 03:57:21 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:21 user nova-compute[72793]:     <apic/>
Aug 17 03:57:21 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:21 user nova-compute[72793]:   </features>
Aug 17 03:57:21 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:21 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:21 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:21 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:21 user nova-compute[72793]:   </clock>
Aug 17 03:57:21 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:21 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:21 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:21 user nova-compute[72793]:   </cpu>
Aug 17 03:57:21 user nova-compute[72793]:   <devices>
Aug 17 03:57:21 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:21 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:21 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk"/>
Aug 17 03:57:21 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:21 user nova-compute[72793]:     </disk>
Aug 17 03:57:21 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:21 user nova-compute[72793]:       <mac address="fa:16:3e:73:21:bf"/>
Aug 17 03:57:21 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:21 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:21 user nova-compute[72793]:       <target dev="tapfcf0e2da-57"/>
Aug 17 03:57:21 user nova-compute[72793]:     </interface>
Aug 17 03:57:21 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:21 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/console.log" append="off"/>
Aug 17 03:57:21 user nova-compute[72793]:     </serial>
Aug 17 03:57:21 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:21 user nova-compute[72793]:     <video>
Aug 17 03:57:21 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:21 user nova-compute[72793]:     </video>
Aug 17 03:57:21 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:21 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:21 user nova-compute[72793]:     </rng>
Aug 17 03:57:21 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:21 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:21 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:21 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:21 user nova-compute[72793]:   </devices>
Aug 17 03:57:21 user nova-compute[72793]: </domain>
Aug 17 03:57:21 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG os_vif [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user sudo[82373]: pam_unix(sudo:session): session closed for user root
Aug 17 03:57:21 user nova-compute[72793]: INFO oslo.privsep.daemon [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Spawned new privsep daemon via rootwrap
Aug 17 03:57:21 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 03:57:21 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 03:57:21 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 03:57:21 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82380
Aug 17 03:57:21 user nova-compute[72793]: WARNING oslo_privsep.priv_context [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] privsep daemon already running
Aug 17 03:57:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updated VIF entry in instance network info cache for port df034dbc-5143-41fb-8ed9-44afac950ce8. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updating instance_info_cache with network_info: [{"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-38def8f7-5c6c-4360-ad5c-68da3a90577b req-6f8a0fbf-ba58-4dc0-966a-a82802826f0a service nova] Releasing lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf0e2da-57, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcf0e2da-57, col_values=(('external_ids', {'iface-id': 'fcf0e2da-57d4-4b11-8d5d-4410979612d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:21:bf', 'vm-uuid': '07328c90-993b-4b0c-8673-04c850aae29c'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: INFO os_vif [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57')
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf034dbc-51, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf034dbc-51, col_values=(('external_ids', {'iface-id': 'df034dbc-5143-41fb-8ed9-44afac950ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:d6:75', 'vm-uuid': 'af93423f-79c3-4f93-89ca-32be3c13f74f'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:21 user nova-compute[72793]: INFO os_vif [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51')
Aug 17 03:57:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No VIF found with MAC fa:16:3e:73:21:bf, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] No VIF found with MAC fa:16:3e:8f:d6:75, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updated VIF entry in instance network info cache for port fcf0e2da-57d4-4b11-8d5d-4410979612d7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b80ced73-ae66-43be-8b47-a62c85117691 req-c523db37-adc8-44cd-a449-875064c6fa87 service nova] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:25 user nova-compute[72793]: INFO nova.compute.claims [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Claim successful on node user
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.network.neutron [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Creating image(s)
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "/opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "/opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.policy [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65891e5eae334ee38675df619856db02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6b688c6c95499ab90009d73f378a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.295s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244646.616063, af93423f-79c3-4f93-89ca-32be3c13f74f => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] VM Resumed (Lifecycle Event)
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Instance spawned successfully.
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance spawned successfully.
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk 1073741824" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244646.6184149, af93423f-79c3-4f93-89ca-32be3c13f74f => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] VM Started (Lifecycle Event)
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Took 16.17 seconds to spawn the instance on the hypervisor.
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Took 14.10 seconds to spawn the instance on the hypervisor.
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:26 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244646.6239152, 07328c90-993b-4b0c-8673-04c850aae29c => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Resumed (Lifecycle Event)
Aug 17 03:57:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.219s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:27 user nova-compute[72793]: INFO nova.compute.manager [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Took 14.88 seconds to build instance.
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:27 user nova-compute[72793]: INFO nova.compute.manager [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Took 17.21 seconds to build instance.
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f7c1f197-d73c-4c2f-bdce-0cea747aa0a6 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.022s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244646.6241472, 07328c90-993b-4b0c-8673-04c850aae29c => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Started (Lifecycle Event)
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-03af737a-f649-4ecf-a3bd-4accf9cfa8b3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.447s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Cannot resize image /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.objects.instance [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'migration_context' on Instance uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Ensure instance console log exists: /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:28 user nova-compute[72793]: DEBUG nova.network.neutron [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Successfully created port: 85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Successfully updated port: 85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-changed-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Refreshing instance network info cache due to event network-changed-85751269-3e2b-4a54-a738-f2532f5d07b9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.network.neutron [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Instance network_info: |[{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.network.neutron [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Refreshing network info cache for port 85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Start _get_guest_xml network_info=[{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:31 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:31 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1315053363',display_name='tempest-ServerActionsTestOtherA-server-1315053363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1315053363',id=3,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-g5ws0s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=c7f6a855-05f1-4019-89a2-5fd75e206edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.objects.instance [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_devices' on Instance uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:31 user nova-compute[72793]:   <uuid>c7f6a855-05f1-4019-89a2-5fd75e206edc</uuid>
Aug 17 03:57:31 user nova-compute[72793]:   <name>instance-00000003</name>
Aug 17 03:57:31 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:31 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:31 user nova-compute[72793]:   <metadata>
Aug 17 03:57:31 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:31 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:31 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherA-server-1315053363</nova:name>
Aug 17 03:57:31 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:31</nova:creationTime>
Aug 17 03:57:31 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:31 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:31 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:31 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:user uuid="65891e5eae334ee38675df619856db02">tempest-ServerActionsTestOtherA-1498578162-project-member</nova:user>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:project uuid="8c6b688c6c95499ab90009d73f378a92">tempest-ServerActionsTestOtherA-1498578162</nova:project>
Aug 17 03:57:31 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:31 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:31 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:31 user nova-compute[72793]:         <nova:port uuid="85751269-3e2b-4a54-a738-f2532f5d07b9">
Aug 17 03:57:31 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 03:57:31 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:31 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:31 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:31 user nova-compute[72793]:   </metadata>
Aug 17 03:57:31 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:31 user nova-compute[72793]:     <system>
Aug 17 03:57:31 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:31 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:31 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:31 user nova-compute[72793]:       <entry name="serial">c7f6a855-05f1-4019-89a2-5fd75e206edc</entry>
Aug 17 03:57:31 user nova-compute[72793]:       <entry name="uuid">c7f6a855-05f1-4019-89a2-5fd75e206edc</entry>
Aug 17 03:57:31 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:31 user nova-compute[72793]:     </system>
Aug 17 03:57:31 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:31 user nova-compute[72793]:   <os>
Aug 17 03:57:31 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:31 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:31 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:31 user nova-compute[72793]:   </os>
Aug 17 03:57:31 user nova-compute[72793]:   <features>
Aug 17 03:57:31 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:31 user nova-compute[72793]:     <apic/>
Aug 17 03:57:31 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:31 user nova-compute[72793]:   </features>
Aug 17 03:57:31 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:31 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:31 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:31 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:31 user nova-compute[72793]:   </clock>
Aug 17 03:57:31 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:31 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:31 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:31 user nova-compute[72793]:   </cpu>
Aug 17 03:57:31 user nova-compute[72793]:   <devices>
Aug 17 03:57:31 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:31 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:31 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk"/>
Aug 17 03:57:31 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:31 user nova-compute[72793]:     </disk>
Aug 17 03:57:31 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:31 user nova-compute[72793]:       <mac address="fa:16:3e:24:7a:e2"/>
Aug 17 03:57:31 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:31 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:31 user nova-compute[72793]:       <target dev="tap85751269-3e"/>
Aug 17 03:57:31 user nova-compute[72793]:     </interface>
Aug 17 03:57:31 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:31 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/console.log" append="off"/>
Aug 17 03:57:31 user nova-compute[72793]:     </serial>
Aug 17 03:57:31 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:31 user nova-compute[72793]:     <video>
Aug 17 03:57:31 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:31 user nova-compute[72793]:     </video>
Aug 17 03:57:31 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:31 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:31 user nova-compute[72793]:     </rng>
Aug 17 03:57:31 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:31 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:31 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:31 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:31 user nova-compute[72793]:   </devices>
Aug 17 03:57:31 user nova-compute[72793]: </domain>
Aug 17 03:57:31 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1315053363',display_name='tempest-ServerActionsTestOtherA-server-1315053363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1315053363',id=3,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-g5ws0s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=c7f6a855-05f1-4019-89a2-5fd75e206edc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG os_vif [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85751269-3e, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85751269-3e, col_values=(('external_ids', {'iface-id': '85751269-3e2b-4a54-a738-f2532f5d07b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:7a:e2', 'vm-uuid': 'c7f6a855-05f1-4019-89a2-5fd75e206edc'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:31 user nova-compute[72793]: INFO os_vif [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e')
Aug 17 03:57:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No VIF found with MAC fa:16:3e:24:7a:e2, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated VIF entry in instance network info cache for port 85751269-3e2b-4a54-a738-f2532f5d07b9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4fe803af-ee73-4305-bbe5-a46f5a5bb29b req-ce50671e-535d-44c2-9508-e682fed7f7bb service nova] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244656.7079577, c7f6a855-05f1-4019-89a2-5fd75e206edc => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] VM Resumed (Lifecycle Event)
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:57:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Instance spawned successfully.
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244656.709601, c7f6a855-05f1-4019-89a2-5fd75e206edc => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] VM Started (Lifecycle Event)
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:36 user nova-compute[72793]: INFO nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Took 10.85 seconds to spawn the instance on the hypervisor.
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:37 user nova-compute[72793]: INFO nova.compute.manager [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Took 11.87 seconds to build instance.
Aug 17 03:57:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-461dc9bc-da25-4d73-9ba2-753ede4c2fcc tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.101s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:40 user nova-compute[72793]: INFO nova.compute.claims [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Claim successful on node user
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:40 user nova-compute[72793]: DEBUG nova.policy [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82e025f0dc8745b3bf13231832816033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b479f01844391a15d9b00afc60453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Creating image(s)
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "/opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "/opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "/opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.316s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.297s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk 1073741824" returned: 0 in 0.070s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.381s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Successfully created port: 1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-281858b0-c1b7-4530-b21f-40e5d611910f req-87b9321c-2a92-424a-93f9-2f66cb185db0 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-281858b0-c1b7-4530-b21f-40e5d611910f req-87b9321c-2a92-424a-93f9-2f66cb185db0 service nova] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-281858b0-c1b7-4530-b21f-40e5d611910f req-87b9321c-2a92-424a-93f9-2f66cb185db0 service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-281858b0-c1b7-4530-b21f-40e5d611910f req-87b9321c-2a92-424a-93f9-2f66cb185db0 service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-281858b0-c1b7-4530-b21f-40e5d611910f req-87b9321c-2a92-424a-93f9-2f66cb185db0 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] No waiting events found dispatching network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:42 user nova-compute[72793]: WARNING nova.compute.manager [req-281858b0-c1b7-4530-b21f-40e5d611910f req-87b9321c-2a92-424a-93f9-2f66cb185db0 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received unexpected event network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 for instance with vm_state active and task_state None.
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.346s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:42 user nova-compute[72793]: INFO nova.compute.claims [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Claim successful on node user
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.437s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Cannot resize image /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'migration_context' on Instance uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Ensure instance console log exists: /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:43 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:43 user nova-compute[72793]: INFO nova.compute.claims [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Claim successful on node user
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Successfully updated port: 1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquired lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.policy [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b32578702526492f8787da3739c7e292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c795498241724a9f9784f66fa14a6b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:43 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Creating image(s)
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "/opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "/opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.281s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:43 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.241s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk 1073741824" returned: 0 in 0.106s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] No waiting events found dispatching network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:44 user nova-compute[72793]: WARNING nova.compute.manager [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received unexpected event network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 for instance with vm_state active and task_state None.
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-changed-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Refreshing instance network info cache due to event network-changed-1882c318-973b-4db1-940f-1e0613b27897. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] Acquiring lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.279s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating instance_info_cache with network_info: [{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Releasing lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Instance network_info: |[{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] Acquired lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Refreshing network info cache for port 1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Start _get_guest_xml network_info=[{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-90886938',display_name='tempest-VolumesAdminNegativeTest-server-90886938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-90886938',id=4,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnKoEiWtcq/eyzJ+6JUOZwtnrS0xeMp8tv93xbyxnaUpoEKx+NHI9oimh8i7D8axHPpK0fkufXaYi/ZK76hJ0qfjgPPbadr7rSohsuQelqLbf3JWioxJkbkQqX4mEOJgg==',key_name='tempest-keypair-1493695895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584b479f01844391a15d9b00afc60453',ramdisk_id='',reservation_id='r-rf0epvtj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-540254454',owner_user_name='tempest-VolumesAdminNegativeTest-540254454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82e025f0dc8745b3bf13231832816033',uuid=62329071-aa56-4d72-9053-e84606823cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converting VIF {"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'pci_devices' on Instance uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Cannot resize image /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lazy-loading 'migration_context' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:44 user nova-compute[72793]:   <uuid>62329071-aa56-4d72-9053-e84606823cd1</uuid>
Aug 17 03:57:44 user nova-compute[72793]:   <name>instance-00000004</name>
Aug 17 03:57:44 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:44 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:44 user nova-compute[72793]:   <metadata>
Aug 17 03:57:44 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:44 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:44 user nova-compute[72793]:       <nova:name>tempest-VolumesAdminNegativeTest-server-90886938</nova:name>
Aug 17 03:57:44 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:44</nova:creationTime>
Aug 17 03:57:44 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:44 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:44 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:44 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:user uuid="82e025f0dc8745b3bf13231832816033">tempest-VolumesAdminNegativeTest-540254454-project-member</nova:user>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:project uuid="584b479f01844391a15d9b00afc60453">tempest-VolumesAdminNegativeTest-540254454</nova:project>
Aug 17 03:57:44 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:44 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:44 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:44 user nova-compute[72793]:         <nova:port uuid="1882c318-973b-4db1-940f-1e0613b27897">
Aug 17 03:57:44 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 03:57:44 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:44 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:44 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:44 user nova-compute[72793]:   </metadata>
Aug 17 03:57:44 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:44 user nova-compute[72793]:     <system>
Aug 17 03:57:44 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:44 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:44 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:44 user nova-compute[72793]:       <entry name="serial">62329071-aa56-4d72-9053-e84606823cd1</entry>
Aug 17 03:57:44 user nova-compute[72793]:       <entry name="uuid">62329071-aa56-4d72-9053-e84606823cd1</entry>
Aug 17 03:57:44 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:44 user nova-compute[72793]:     </system>
Aug 17 03:57:44 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:44 user nova-compute[72793]:   <os>
Aug 17 03:57:44 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:44 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:44 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:44 user nova-compute[72793]:   </os>
Aug 17 03:57:44 user nova-compute[72793]:   <features>
Aug 17 03:57:44 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:44 user nova-compute[72793]:     <apic/>
Aug 17 03:57:44 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:44 user nova-compute[72793]:   </features>
Aug 17 03:57:44 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:44 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:44 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:44 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:44 user nova-compute[72793]:   </clock>
Aug 17 03:57:44 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:44 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:44 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:44 user nova-compute[72793]:   </cpu>
Aug 17 03:57:44 user nova-compute[72793]:   <devices>
Aug 17 03:57:44 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:44 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:44 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk"/>
Aug 17 03:57:44 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:44 user nova-compute[72793]:     </disk>
Aug 17 03:57:44 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:44 user nova-compute[72793]:       <mac address="fa:16:3e:96:24:8a"/>
Aug 17 03:57:44 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:44 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:44 user nova-compute[72793]:       <target dev="tap1882c318-97"/>
Aug 17 03:57:44 user nova-compute[72793]:     </interface>
Aug 17 03:57:44 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:44 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/console.log" append="off"/>
Aug 17 03:57:44 user nova-compute[72793]:     </serial>
Aug 17 03:57:44 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:44 user nova-compute[72793]:     <video>
Aug 17 03:57:44 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:44 user nova-compute[72793]:     </video>
Aug 17 03:57:44 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:44 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:44 user nova-compute[72793]:     </rng>
Aug 17 03:57:44 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:44 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:44 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:44 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:44 user nova-compute[72793]:   </devices>
Aug 17 03:57:44 user nova-compute[72793]: </domain>
Aug 17 03:57:44 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-90886938',display_name='tempest-VolumesAdminNegativeTest-server-90886938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-90886938',id=4,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnKoEiWtcq/eyzJ+6JUOZwtnrS0xeMp8tv93xbyxnaUpoEKx+NHI9oimh8i7D8axHPpK0fkufXaYi/ZK76hJ0qfjgPPbadr7rSohsuQelqLbf3JWioxJkbkQqX4mEOJgg==',key_name='tempest-keypair-1493695895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584b479f01844391a15d9b00afc60453',ramdisk_id='',reservation_id='r-rf0epvtj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-540254454',owner_user_name='tempest-VolumesAdminNegativeTest-540254454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82e025f0dc8745b3bf13231832816033',uuid=62329071-aa56-4d72-9053-e84606823cd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converting VIF {"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG os_vif [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Ensure instance console log exists: /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1882c318-97, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1882c318-97, col_values=(('external_ids', {'iface-id': '1882c318-973b-4db1-940f-1e0613b27897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:24:8a', 'vm-uuid': '62329071-aa56-4d72-9053-e84606823cd1'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.policy [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd00021a75fc400081f34179e388e58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb76bc5bdb542d182aceecdfdabb0e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:44 user nova-compute[72793]: INFO os_vif [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97')
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No VIF found with MAC fa:16:3e:96:24:8a, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:45 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Creating image(s)
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "/opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "/opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "/opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "1dd387cb2b41eb8bdc4580649561b19731aba7b1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "1dd387cb2b41eb8bdc4580649561b19731aba7b1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Successfully created port: dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.part --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG nova.virt.images [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] eec7ef4f-707a-477b-a841-68eaa56af11c was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 03:57:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.part /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:46 user nova-compute[72793]: INFO nova.compute.claims [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Claim successful on node user
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.part /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.converted" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Successfully created port: 6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.network.neutron [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updated VIF entry in instance network info cache for port 1882c318-973b-4db1-940f-1e0613b27897. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.network.neutron [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating instance_info_cache with network_info: [{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a85c56b7-1033-4447-83e7-fa21a68fb0d0 req-4faf81da-040c-479c-bc90-a845f39b8ad1 service nova] Releasing lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "1dd387cb2b41eb8bdc4580649561b19731aba7b1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.372s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 --force-share --output=json" returned: 0 in 0.220s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "1dd387cb2b41eb8bdc4580649561b19731aba7b1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "1dd387cb2b41eb8bdc4580649561b19731aba7b1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 --force-share --output=json" returned: 0 in 0.235s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1,backing_fmt=raw /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG nova.policy [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b417e88ac27f494997b2d548630a4799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163e4f83cf6c496daaefcf07f2458334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1,backing_fmt=raw /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk 1073741824" returned: 0 in 0.096s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "1dd387cb2b41eb8bdc4580649561b19731aba7b1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Creating image(s)
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "/opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "/opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "/opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 --force-share --output=json" returned: 0 in 0.315s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Checking if we can resize image /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.237s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Successfully updated port: dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-changed-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Refreshing instance network info cache due to event network-changed-dfcb202e-d8ad-4753-9251-88500aa6ac09. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] Acquiring lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] Acquired lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Refreshing network info cache for port dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Cannot resize image /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lazy-loading 'migration_context' on Instance uuid 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Ensure instance console log exists: /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.249s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk 1073741824" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Successfully updated port: 6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-changed-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Refreshing instance network info cache due to event network-changed-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] Acquiring lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] Acquired lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Refreshing network info cache for port 6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Cannot resize image /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lazy-loading 'migration_context' on Instance uuid db7dfa83-dd42-427d-9b41-1b308e7448be {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Ensure instance console log exists: /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-acad8863-a6f8-42aa-bdd2-081bf7f26972 req-6ff387ea-b10a-49cf-a738-948efd53f577 service nova] Releasing lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquired lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a280e01-c5c1-4de2-9bdd-e09166fd465d req-c83d69a7-a09a-44a8-93e6-6a2996f838b1 service nova] Releasing lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquired lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Updating instance_info_cache with network_info: [{"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Releasing lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Instance network_info: |[{"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Start _get_guest_xml network_info=[{"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1614138123',display_name='tempest-VolumesAssistedSnapshotsTest-server-1614138123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1614138123',id=5,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkzqeDXLfp7YXS7BsZj8d8e3rhLzmEDvl1Q/nWjavVlbDZhgPehTSdm2wxDo8myKXlyhRMqXFE6dhRFu8JGmJ/w2BBUYkiBj9pGxsAWTFvRLfZ/wOTH/Ky7/sWIRhdH/g==',key_name='tempest-keypair-861197071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c795498241724a9f9784f66fa14a6b50',ramdisk_id='',reservation_id='r-edd51nx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1389464626',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1389464626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b32578702526492f8787da3739c7e292',uuid=2f348045-d3ba-409a-b57b-58bbdd86341c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Converting VIF {"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Successfully created port: b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:48 user nova-compute[72793]:   <uuid>2f348045-d3ba-409a-b57b-58bbdd86341c</uuid>
Aug 17 03:57:48 user nova-compute[72793]:   <name>instance-00000005</name>
Aug 17 03:57:48 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:48 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:48 user nova-compute[72793]:   <metadata>
Aug 17 03:57:48 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:48 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:48 user nova-compute[72793]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1614138123</nova:name>
Aug 17 03:57:48 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:48</nova:creationTime>
Aug 17 03:57:48 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:48 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:48 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:48 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:user uuid="b32578702526492f8787da3739c7e292">tempest-VolumesAssistedSnapshotsTest-1389464626-project-member</nova:user>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:project uuid="c795498241724a9f9784f66fa14a6b50">tempest-VolumesAssistedSnapshotsTest-1389464626</nova:project>
Aug 17 03:57:48 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:48 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:48 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:48 user nova-compute[72793]:         <nova:port uuid="dfcb202e-d8ad-4753-9251-88500aa6ac09">
Aug 17 03:57:48 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 03:57:48 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:48 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:48 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:48 user nova-compute[72793]:   </metadata>
Aug 17 03:57:48 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:48 user nova-compute[72793]:     <system>
Aug 17 03:57:48 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:48 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:48 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:48 user nova-compute[72793]:       <entry name="serial">2f348045-d3ba-409a-b57b-58bbdd86341c</entry>
Aug 17 03:57:48 user nova-compute[72793]:       <entry name="uuid">2f348045-d3ba-409a-b57b-58bbdd86341c</entry>
Aug 17 03:57:48 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:48 user nova-compute[72793]:     </system>
Aug 17 03:57:48 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:48 user nova-compute[72793]:   <os>
Aug 17 03:57:48 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:48 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:48 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:48 user nova-compute[72793]:   </os>
Aug 17 03:57:48 user nova-compute[72793]:   <features>
Aug 17 03:57:48 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:48 user nova-compute[72793]:     <apic/>
Aug 17 03:57:48 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:48 user nova-compute[72793]:   </features>
Aug 17 03:57:48 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:48 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:48 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:48 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:48 user nova-compute[72793]:   </clock>
Aug 17 03:57:48 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:48 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:48 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:48 user nova-compute[72793]:   </cpu>
Aug 17 03:57:48 user nova-compute[72793]:   <devices>
Aug 17 03:57:48 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:48 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:48 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk"/>
Aug 17 03:57:48 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:48 user nova-compute[72793]:     </disk>
Aug 17 03:57:48 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:48 user nova-compute[72793]:       <mac address="fa:16:3e:f1:4a:dd"/>
Aug 17 03:57:48 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:48 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:48 user nova-compute[72793]:       <target dev="tapdfcb202e-d8"/>
Aug 17 03:57:48 user nova-compute[72793]:     </interface>
Aug 17 03:57:48 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:48 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/console.log" append="off"/>
Aug 17 03:57:48 user nova-compute[72793]:     </serial>
Aug 17 03:57:48 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:48 user nova-compute[72793]:     <video>
Aug 17 03:57:48 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:48 user nova-compute[72793]:     </video>
Aug 17 03:57:48 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:48 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:48 user nova-compute[72793]:     </rng>
Aug 17 03:57:48 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:48 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:48 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:48 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:48 user nova-compute[72793]:   </devices>
Aug 17 03:57:48 user nova-compute[72793]: </domain>
Aug 17 03:57:48 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1614138123',display_name='tempest-VolumesAssistedSnapshotsTest-server-1614138123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1614138123',id=5,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkzqeDXLfp7YXS7BsZj8d8e3rhLzmEDvl1Q/nWjavVlbDZhgPehTSdm2wxDo8myKXlyhRMqXFE6dhRFu8JGmJ/w2BBUYkiBj9pGxsAWTFvRLfZ/wOTH/Ky7/sWIRhdH/g==',key_name='tempest-keypair-861197071',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c795498241724a9f9784f66fa14a6b50',ramdisk_id='',reservation_id='r-edd51nx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1389464626',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1389464626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b32578702526492f8787da3739c7e292',uuid=2f348045-d3ba-409a-b57b-58bbdd86341c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Converting VIF {"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG os_vif [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfcb202e-d8, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfcb202e-d8, col_values=(('external_ids', {'iface-id': 'dfcb202e-d8ad-4753-9251-88500aa6ac09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:4a:dd', 'vm-uuid': '2f348045-d3ba-409a-b57b-58bbdd86341c'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:48 user nova-compute[72793]: INFO os_vif [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8')
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updating instance_info_cache with network_info: [{"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] No VIF found with MAC fa:16:3e:f1:4a:dd, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Releasing lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Instance network_info: |[{"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Start _get_guest_xml network_info=[{"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:57:34Z,direct_url=<?>,disk_format='qcow2',id=eec7ef4f-707a-477b-a841-68eaa56af11c,min_disk=0,min_ram=0,name='',owner='149f483892d6491c991cecd9d9052d90',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:57:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'guest_format': None, 'device_type': 'disk', 'image_id': 'eec7ef4f-707a-477b-a841-68eaa56af11c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:49 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:49 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:57:34Z,direct_url=<?>,disk_format='qcow2',id=eec7ef4f-707a-477b-a841-68eaa56af11c,min_disk=0,min_ram=0,name='',owner='149f483892d6491c991cecd9d9052d90',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:57:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-860631933',display_name='tempest-AttachSCSIVolumeTestJSON-server-860631933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-860631933',id=6,image_ref='eec7ef4f-707a-477b-a841-68eaa56af11c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLb8Is51FuyujMUUqL5JqENY0CtrBjOwc00MxPpRSsL6r3teVclqWvhDjBDOrt4XWslG+ua2PWL1Yo29TLR1xIeq+Tfv35Q+icS4Kl+ESR3h6YH6wDCWVQVAHW2X+YYnQ==',key_name='tempest-keypair-1914423591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb76bc5bdb542d182aceecdfdabb0e4',ramdisk_id='',reservation_id='r-0b0ep0k7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='eec7ef4f-707a-477b-a841-68eaa56af11c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1340770866',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1340770866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd00021a75fc400081f34179e388e58d',uuid=706f36b4-71ed-4433-8598-e22a8d47d24a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Converting VIF {"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.objects.instance [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lazy-loading 'pci_devices' on Instance uuid 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:49 user nova-compute[72793]:   <uuid>706f36b4-71ed-4433-8598-e22a8d47d24a</uuid>
Aug 17 03:57:49 user nova-compute[72793]:   <name>instance-00000006</name>
Aug 17 03:57:49 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:49 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:49 user nova-compute[72793]:   <metadata>
Aug 17 03:57:49 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:49 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:49 user nova-compute[72793]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-860631933</nova:name>
Aug 17 03:57:49 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:49</nova:creationTime>
Aug 17 03:57:49 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:49 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:49 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:49 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:user uuid="cd00021a75fc400081f34179e388e58d">tempest-AttachSCSIVolumeTestJSON-1340770866-project-member</nova:user>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:project uuid="fdb76bc5bdb542d182aceecdfdabb0e4">tempest-AttachSCSIVolumeTestJSON-1340770866</nova:project>
Aug 17 03:57:49 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:49 user nova-compute[72793]:       <nova:root type="image" uuid="eec7ef4f-707a-477b-a841-68eaa56af11c"/>
Aug 17 03:57:49 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:49 user nova-compute[72793]:         <nova:port uuid="6e64c7aa-cb61-4d85-92cf-f7bb30cfc176">
Aug 17 03:57:49 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 03:57:49 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:49 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:49 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:49 user nova-compute[72793]:   </metadata>
Aug 17 03:57:49 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:49 user nova-compute[72793]:     <system>
Aug 17 03:57:49 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:49 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:49 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:49 user nova-compute[72793]:       <entry name="serial">706f36b4-71ed-4433-8598-e22a8d47d24a</entry>
Aug 17 03:57:49 user nova-compute[72793]:       <entry name="uuid">706f36b4-71ed-4433-8598-e22a8d47d24a</entry>
Aug 17 03:57:49 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:49 user nova-compute[72793]:     </system>
Aug 17 03:57:49 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:49 user nova-compute[72793]:   <os>
Aug 17 03:57:49 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:49 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:49 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:49 user nova-compute[72793]:   </os>
Aug 17 03:57:49 user nova-compute[72793]:   <features>
Aug 17 03:57:49 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:49 user nova-compute[72793]:     <apic/>
Aug 17 03:57:49 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:49 user nova-compute[72793]:   </features>
Aug 17 03:57:49 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:49 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:49 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:49 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:49 user nova-compute[72793]:   </clock>
Aug 17 03:57:49 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:49 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:49 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:49 user nova-compute[72793]:   </cpu>
Aug 17 03:57:49 user nova-compute[72793]:   <devices>
Aug 17 03:57:49 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:49 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:49 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk"/>
Aug 17 03:57:49 user nova-compute[72793]:       <target dev="sda" bus="scsi"/>
Aug 17 03:57:49 user nova-compute[72793]:       <address type="drive" controller="0" unit="0"/>
Aug 17 03:57:49 user nova-compute[72793]:     </disk>
Aug 17 03:57:49 user nova-compute[72793]:     <disk type="file" device="cdrom">
Aug 17 03:57:49 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 03:57:49 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.config"/>
Aug 17 03:57:49 user nova-compute[72793]:       <target dev="sdb" bus="scsi"/>
Aug 17 03:57:49 user nova-compute[72793]:       <address type="drive" controller="0" unit="1"/>
Aug 17 03:57:49 user nova-compute[72793]:     </disk>
Aug 17 03:57:49 user nova-compute[72793]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 03:57:49 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:49 user nova-compute[72793]:       <mac address="fa:16:3e:7e:9f:73"/>
Aug 17 03:57:49 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:49 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:49 user nova-compute[72793]:       <target dev="tap6e64c7aa-cb"/>
Aug 17 03:57:49 user nova-compute[72793]:     </interface>
Aug 17 03:57:49 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:49 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/console.log" append="off"/>
Aug 17 03:57:49 user nova-compute[72793]:     </serial>
Aug 17 03:57:49 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:49 user nova-compute[72793]:     <video>
Aug 17 03:57:49 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:49 user nova-compute[72793]:     </video>
Aug 17 03:57:49 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:49 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:49 user nova-compute[72793]:     </rng>
Aug 17 03:57:49 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:49 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:49 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:49 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:49 user nova-compute[72793]:   </devices>
Aug 17 03:57:49 user nova-compute[72793]: </domain>
Aug 17 03:57:49 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-860631933',display_name='tempest-AttachSCSIVolumeTestJSON-server-860631933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-860631933',id=6,image_ref='eec7ef4f-707a-477b-a841-68eaa56af11c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLb8Is51FuyujMUUqL5JqENY0CtrBjOwc00MxPpRSsL6r3teVclqWvhDjBDOrt4XWslG+ua2PWL1Yo29TLR1xIeq+Tfv35Q+icS4Kl+ESR3h6YH6wDCWVQVAHW2X+YYnQ==',key_name='tempest-keypair-1914423591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb76bc5bdb542d182aceecdfdabb0e4',ramdisk_id='',reservation_id='r-0b0ep0k7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='eec7ef4f-707a-477b-a841-68eaa56af11c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1340770866',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1340770866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd00021a75fc400081f34179e388e58d',uuid=706f36b4-71ed-4433-8598-e22a8d47d24a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Converting VIF {"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG os_vif [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e64c7aa-cb, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e64c7aa-cb, col_values=(('external_ids', {'iface-id': '6e64c7aa-cb61-4d85-92cf-f7bb30cfc176', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:9f:73', 'vm-uuid': '706f36b4-71ed-4433-8598-e22a8d47d24a'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244669.1901512, 62329071-aa56-4d72-9053-e84606823cd1 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] VM Resumed (Lifecycle Event)
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:49 user nova-compute[72793]: INFO os_vif [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb')
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Instance spawned successfully.
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244669.1971912, 62329071-aa56-4d72-9053-e84606823cd1 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] VM Started (Lifecycle Event)
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No BDM found with device name sda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No VIF found with MAC fa:16:3e:7e:9f:73, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Using config drive
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Took 8.34 seconds to spawn the instance on the hypervisor.
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.compute.manager [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Took 9.40 seconds to build instance.
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2dde1347-dbca-436e-bb0f-7d5fdb378486 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.602s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-efdd15d0-cadf-46c6-9c48-449da2c0f6e2 req-2b1ac126-d7be-44d6-9c03-9b51f9c6702c service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-efdd15d0-cadf-46c6-9c48-449da2c0f6e2 req-2b1ac126-d7be-44d6-9c03-9b51f9c6702c service nova] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-efdd15d0-cadf-46c6-9c48-449da2c0f6e2 req-2b1ac126-d7be-44d6-9c03-9b51f9c6702c service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-efdd15d0-cadf-46c6-9c48-449da2c0f6e2 req-2b1ac126-d7be-44d6-9c03-9b51f9c6702c service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-efdd15d0-cadf-46c6-9c48-449da2c0f6e2 req-2b1ac126-d7be-44d6-9c03-9b51f9c6702c service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] No waiting events found dispatching network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:49 user nova-compute[72793]: WARNING nova.compute.manager [req-efdd15d0-cadf-46c6-9c48-449da2c0f6e2 req-2b1ac126-d7be-44d6-9c03-9b51f9c6702c service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received unexpected event network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 for instance with vm_state active and task_state None.
Aug 17 03:57:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Creating config drive at /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.config
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfhq9b6ad {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfhq9b6ad" returned: 0 in 0.070s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:50 user nova-compute[72793]: INFO nova.compute.claims [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Claim successful on node user
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-731a72a0-a716-4667-b9a9-0d2185a1dacb req-5cc71b84-53ed-4062-8602-155b4a367057 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-731a72a0-a716-4667-b9a9-0d2185a1dacb req-5cc71b84-53ed-4062-8602-155b4a367057 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-731a72a0-a716-4667-b9a9-0d2185a1dacb req-5cc71b84-53ed-4062-8602-155b4a367057 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-731a72a0-a716-4667-b9a9-0d2185a1dacb req-5cc71b84-53ed-4062-8602-155b4a367057 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-731a72a0-a716-4667-b9a9-0d2185a1dacb req-5cc71b84-53ed-4062-8602-155b4a367057 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:51 user nova-compute[72793]: WARNING nova.compute.manager [req-731a72a0-a716-4667-b9a9-0d2185a1dacb req-5cc71b84-53ed-4062-8602-155b4a367057 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state None.
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.831s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.082s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:57:51 user nova-compute[72793]: INFO nova.compute.claims [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Claim successful on node user
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.policy [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c5f4dca85614dab85fc905ed14874cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ba4c7a79ab24dd18dff838b38a523d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Creating image(s)
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "/opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "/opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-5434807b-397e-4ee3-883e-c692ef628102 req-886dca58-3a3e-4bc3-9dae-cc00dcf0ac59 service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5434807b-397e-4ee3-883e-c692ef628102 req-886dca58-3a3e-4bc3-9dae-cc00dcf0ac59 service nova] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5434807b-397e-4ee3-883e-c692ef628102 req-886dca58-3a3e-4bc3-9dae-cc00dcf0ac59 service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5434807b-397e-4ee3-883e-c692ef628102 req-886dca58-3a3e-4bc3-9dae-cc00dcf0ac59 service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-5434807b-397e-4ee3-883e-c692ef628102 req-886dca58-3a3e-4bc3-9dae-cc00dcf0ac59 service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] No waiting events found dispatching network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:51 user nova-compute[72793]: WARNING nova.compute.manager [req-5434807b-397e-4ee3-883e-c692ef628102 req-886dca58-3a3e-4bc3-9dae-cc00dcf0ac59 service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received unexpected event network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 for instance with vm_state active and task_state None.
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Successfully updated port: b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "refresh_cache-db7dfa83-dd42-427d-9b41-1b308e7448be" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquired lock "refresh_cache-db7dfa83-dd42-427d-9b41-1b308e7448be" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.255s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:52 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:57:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.361s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.policy [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f0cd34800034c5e9729e92f2388700d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3fafd6d4541c1be05fc81ca6988dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk 1073741824" returned: 0 in 0.108s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.491s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:57:52 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Creating image(s)
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.308s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-02e7f50e-c101-40d9-a147-a6494ddbe2d2 req-24aa7d56-7c17-40ba-85e2-902a3dafa156 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-02e7f50e-c101-40d9-a147-a6494ddbe2d2 req-24aa7d56-7c17-40ba-85e2-902a3dafa156 service nova] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-02e7f50e-c101-40d9-a147-a6494ddbe2d2 req-24aa7d56-7c17-40ba-85e2-902a3dafa156 service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-02e7f50e-c101-40d9-a147-a6494ddbe2d2 req-24aa7d56-7c17-40ba-85e2-902a3dafa156 service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-02e7f50e-c101-40d9-a147-a6494ddbe2d2 req-24aa7d56-7c17-40ba-85e2-902a3dafa156 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] No waiting events found dispatching network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:52 user nova-compute[72793]: WARNING nova.compute.manager [req-02e7f50e-c101-40d9-a147-a6494ddbe2d2 req-24aa7d56-7c17-40ba-85e2-902a3dafa156 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received unexpected event network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 for instance with vm_state building and task_state spawning.
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.328s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Cannot resize image /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:52 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lazy-loading 'migration_context' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Ensure instance console log exists: /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Successfully created port: defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.270s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk 1073741824" returned: 0 in 0.069s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Updating instance_info_cache with network_info: [{"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:53 user nova-compute[72793]: WARNING nova.compute.manager [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state None.
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-changed-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Refreshing instance network info cache due to event network-changed-b755de37-76d7-4b63-951c-f8e9d7449f0d. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] Acquiring lock "refresh_cache-db7dfa83-dd42-427d-9b41-1b308e7448be" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Releasing lock "refresh_cache-db7dfa83-dd42-427d-9b41-1b308e7448be" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Instance network_info: |[{"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] Acquired lock "refresh_cache-db7dfa83-dd42-427d-9b41-1b308e7448be" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Refreshing network info cache for port b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Start _get_guest_xml network_info=[{"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:53 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:53 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-226713068',display_name='tempest-VolumesActionsTest-instance-226713068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-226713068',id=7,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='163e4f83cf6c496daaefcf07f2458334',ramdisk_id='',reservation_id='r-e7c30kdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053759356',owner_user_name='tempest-VolumesActionsTest-2053759356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:47Z,user_data=None,user_id='b417e88ac27f494997b2d548630a4799',uuid=db7dfa83-dd42-427d-9b41-1b308e7448be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converting VIF {"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lazy-loading 'pci_devices' on Instance uuid db7dfa83-dd42-427d-9b41-1b308e7448be {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:53 user nova-compute[72793]:   <uuid>db7dfa83-dd42-427d-9b41-1b308e7448be</uuid>
Aug 17 03:57:53 user nova-compute[72793]:   <name>instance-00000007</name>
Aug 17 03:57:53 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:53 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:53 user nova-compute[72793]:   <metadata>
Aug 17 03:57:53 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:53 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:53 user nova-compute[72793]:       <nova:name>tempest-VolumesActionsTest-instance-226713068</nova:name>
Aug 17 03:57:53 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:53</nova:creationTime>
Aug 17 03:57:53 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:53 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:53 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:53 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:user uuid="b417e88ac27f494997b2d548630a4799">tempest-VolumesActionsTest-2053759356-project-member</nova:user>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:project uuid="163e4f83cf6c496daaefcf07f2458334">tempest-VolumesActionsTest-2053759356</nova:project>
Aug 17 03:57:53 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:53 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:53 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:53 user nova-compute[72793]:         <nova:port uuid="b755de37-76d7-4b63-951c-f8e9d7449f0d">
Aug 17 03:57:53 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 03:57:53 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:53 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:53 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:53 user nova-compute[72793]:   </metadata>
Aug 17 03:57:53 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:53 user nova-compute[72793]:     <system>
Aug 17 03:57:53 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:53 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:53 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:53 user nova-compute[72793]:       <entry name="serial">db7dfa83-dd42-427d-9b41-1b308e7448be</entry>
Aug 17 03:57:53 user nova-compute[72793]:       <entry name="uuid">db7dfa83-dd42-427d-9b41-1b308e7448be</entry>
Aug 17 03:57:53 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:53 user nova-compute[72793]:     </system>
Aug 17 03:57:53 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:53 user nova-compute[72793]:   <os>
Aug 17 03:57:53 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:53 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:53 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:53 user nova-compute[72793]:   </os>
Aug 17 03:57:53 user nova-compute[72793]:   <features>
Aug 17 03:57:53 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:53 user nova-compute[72793]:     <apic/>
Aug 17 03:57:53 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:53 user nova-compute[72793]:   </features>
Aug 17 03:57:53 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:53 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:53 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:53 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:53 user nova-compute[72793]:   </clock>
Aug 17 03:57:53 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:53 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:53 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:53 user nova-compute[72793]:   </cpu>
Aug 17 03:57:53 user nova-compute[72793]:   <devices>
Aug 17 03:57:53 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:53 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:53 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk"/>
Aug 17 03:57:53 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:53 user nova-compute[72793]:     </disk>
Aug 17 03:57:53 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:53 user nova-compute[72793]:       <mac address="fa:16:3e:8a:ff:dd"/>
Aug 17 03:57:53 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:53 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:53 user nova-compute[72793]:       <target dev="tapb755de37-76"/>
Aug 17 03:57:53 user nova-compute[72793]:     </interface>
Aug 17 03:57:53 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:53 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/console.log" append="off"/>
Aug 17 03:57:53 user nova-compute[72793]:     </serial>
Aug 17 03:57:53 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:53 user nova-compute[72793]:     <video>
Aug 17 03:57:53 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:53 user nova-compute[72793]:     </video>
Aug 17 03:57:53 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:53 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:53 user nova-compute[72793]:     </rng>
Aug 17 03:57:53 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:53 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:53 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:53 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:53 user nova-compute[72793]:   </devices>
Aug 17 03:57:53 user nova-compute[72793]: </domain>
Aug 17 03:57:53 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-226713068',display_name='tempest-VolumesActionsTest-instance-226713068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-226713068',id=7,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='163e4f83cf6c496daaefcf07f2458334',ramdisk_id='',reservation_id='r-e7c30kdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053759356',owner_user_name='tempest-VolumesActionsTest-2053759356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:47Z,user_data=None,user_id='b417e88ac27f494997b2d548630a4799',uuid=db7dfa83-dd42-427d-9b41-1b308e7448be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converting VIF {"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG os_vif [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.291s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb755de37-76, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb755de37-76, col_values=(('external_ids', {'iface-id': 'b755de37-76d7-4b63-951c-f8e9d7449f0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:ff:dd', 'vm-uuid': 'db7dfa83-dd42-427d-9b41-1b308e7448be'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:53 user nova-compute[72793]: INFO os_vif [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76')
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] No VIF found with MAC fa:16:3e:8a:ff:dd, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Cannot resize image /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'migration_context' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Ensure instance console log exists: /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Successfully created port: eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Updated VIF entry in instance network info cache for port b755de37-76d7-4b63-951c-f8e9d7449f0d. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Updating instance_info_cache with network_info: [{"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec9388d9-d8b9-47e7-8fa2-893ed2e4cb58 req-295d230c-cecb-46bd-82e6-ae876841aaa5 service nova] Releasing lock "refresh_cache-db7dfa83-dd42-427d-9b41-1b308e7448be" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Successfully updated port: defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquired lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] No waiting events found dispatching network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:57:54 user nova-compute[72793]: WARNING nova.compute.manager [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received unexpected event network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 for instance with vm_state building and task_state spawning.
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-changed-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Refreshing instance network info cache due to event network-changed-defbfa96-c0e2-4651-9ac4-3bff083973d0. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] Acquiring lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updating instance_info_cache with network_info: [{"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Releasing lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Instance network_info: |[{"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] Acquired lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Refreshing network info cache for port defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Start _get_guest_xml network_info=[{"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:55 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:55 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-748305668',display_name='tempest-TestVolumeSwap-server-748305668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-748305668',id=8,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEotFc7rY+clpL/s5uPuq26wWiUz6OdWPeVJ0AD/TPJE6V7vyIZtXhSLSGrFnGGwCCCDVJ7h2936fgat8e5h9ln8NKBJzEtfKqzn2Q4d08BJHfiklTqlSM9rJnR6/jnG+w==',key_name='tempest-keypair-1550518975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ba4c7a79ab24dd18dff838b38a523d4',ramdisk_id='',reservation_id='r-pnl9klxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-176402644',owner_user_name='tempest-TestVolumeSwap-176402644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c5f4dca85614dab85fc905ed14874cc',uuid=8ef016ce-07e3-4fe1-8b99-29cce6862f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Converting VIF {"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:55 user nova-compute[72793]:   <uuid>8ef016ce-07e3-4fe1-8b99-29cce6862f55</uuid>
Aug 17 03:57:55 user nova-compute[72793]:   <name>instance-00000008</name>
Aug 17 03:57:55 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:55 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:55 user nova-compute[72793]:   <metadata>
Aug 17 03:57:55 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:55 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:55 user nova-compute[72793]:       <nova:name>tempest-TestVolumeSwap-server-748305668</nova:name>
Aug 17 03:57:55 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:55</nova:creationTime>
Aug 17 03:57:55 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:55 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:55 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:55 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:user uuid="6c5f4dca85614dab85fc905ed14874cc">tempest-TestVolumeSwap-176402644-project-member</nova:user>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:project uuid="9ba4c7a79ab24dd18dff838b38a523d4">tempest-TestVolumeSwap-176402644</nova:project>
Aug 17 03:57:55 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:55 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:55 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:55 user nova-compute[72793]:         <nova:port uuid="defbfa96-c0e2-4651-9ac4-3bff083973d0">
Aug 17 03:57:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 03:57:55 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:55 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:55 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:55 user nova-compute[72793]:   </metadata>
Aug 17 03:57:55 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:55 user nova-compute[72793]:     <system>
Aug 17 03:57:55 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:55 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:55 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:55 user nova-compute[72793]:       <entry name="serial">8ef016ce-07e3-4fe1-8b99-29cce6862f55</entry>
Aug 17 03:57:55 user nova-compute[72793]:       <entry name="uuid">8ef016ce-07e3-4fe1-8b99-29cce6862f55</entry>
Aug 17 03:57:55 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:55 user nova-compute[72793]:     </system>
Aug 17 03:57:55 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:55 user nova-compute[72793]:   <os>
Aug 17 03:57:55 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:55 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:55 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:55 user nova-compute[72793]:   </os>
Aug 17 03:57:55 user nova-compute[72793]:   <features>
Aug 17 03:57:55 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:55 user nova-compute[72793]:     <apic/>
Aug 17 03:57:55 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:55 user nova-compute[72793]:   </features>
Aug 17 03:57:55 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:55 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:55 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:55 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:55 user nova-compute[72793]:   </clock>
Aug 17 03:57:55 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:55 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:55 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:55 user nova-compute[72793]:   </cpu>
Aug 17 03:57:55 user nova-compute[72793]:   <devices>
Aug 17 03:57:55 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:55 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:55 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk"/>
Aug 17 03:57:55 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:55 user nova-compute[72793]:     </disk>
Aug 17 03:57:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:55 user nova-compute[72793]:       <mac address="fa:16:3e:d4:61:ff"/>
Aug 17 03:57:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:55 user nova-compute[72793]:       <target dev="tapdefbfa96-c0"/>
Aug 17 03:57:55 user nova-compute[72793]:     </interface>
Aug 17 03:57:55 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:55 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/console.log" append="off"/>
Aug 17 03:57:55 user nova-compute[72793]:     </serial>
Aug 17 03:57:55 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:55 user nova-compute[72793]:     <video>
Aug 17 03:57:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:55 user nova-compute[72793]:     </video>
Aug 17 03:57:55 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:55 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:55 user nova-compute[72793]:     </rng>
Aug 17 03:57:55 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:55 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:55 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:55 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:55 user nova-compute[72793]:   </devices>
Aug 17 03:57:55 user nova-compute[72793]: </domain>
Aug 17 03:57:55 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-748305668',display_name='tempest-TestVolumeSwap-server-748305668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-748305668',id=8,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEotFc7rY+clpL/s5uPuq26wWiUz6OdWPeVJ0AD/TPJE6V7vyIZtXhSLSGrFnGGwCCCDVJ7h2936fgat8e5h9ln8NKBJzEtfKqzn2Q4d08BJHfiklTqlSM9rJnR6/jnG+w==',key_name='tempest-keypair-1550518975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ba4c7a79ab24dd18dff838b38a523d4',ramdisk_id='',reservation_id='r-pnl9klxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-176402644',owner_user_name='tempest-TestVolumeSwap-176402644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c5f4dca85614dab85fc905ed14874cc',uuid=8ef016ce-07e3-4fe1-8b99-29cce6862f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Converting VIF {"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG os_vif [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdefbfa96-c0, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdefbfa96-c0, col_values=(('external_ids', {'iface-id': 'defbfa96-c0e2-4651-9ac4-3bff083973d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:61:ff', 'vm-uuid': '8ef016ce-07e3-4fe1-8b99-29cce6862f55'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Successfully updated port: eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: INFO os_vif [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0')
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquired lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-changed-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Refreshing instance network info cache due to event network-changed-eb423df8-c512-4db6-8306-988514364769. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] Acquiring lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] No VIF found with MAC fa:16:3e:d4:61:ff, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updated VIF entry in instance network info cache for port defbfa96-c0e2-4651-9ac4-3bff083973d0. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updating instance_info_cache with network_info: [{"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1c0cb160-acb0-4fb2-8046-1bd0136bdbf4 req-cbbc833c-6b1f-4384-8e91-a7684f451ddc service nova] Releasing lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 03:57:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Releasing lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Instance network_info: |[{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] Acquired lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Refreshing network info cache for port eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Start _get_guest_xml network_info=[{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:57:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:56 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Skipping network cache update for instance because it is Building. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Skipping network cache update for instance because it is Building. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Skipping network cache update for instance because it is Building. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Skipping network cache update for instance because it is Building. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Skipping network cache update for instance because it is Building. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'pci_devices' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244676.0804076, 706f36b4-71ed-4433-8598-e22a8d47d24a => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] VM Resumed (Lifecycle Event)
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:57:56 user nova-compute[72793]:   <uuid>df59fea4-c74f-40c1-bc93-be5085413156</uuid>
Aug 17 03:57:56 user nova-compute[72793]:   <name>instance-00000009</name>
Aug 17 03:57:56 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:57:56 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:57:56 user nova-compute[72793]:   <metadata>
Aug 17 03:57:56 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:57:56 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:57:56 user nova-compute[72793]:       <nova:name>tempest-device-tagging-server-1405185482</nova:name>
Aug 17 03:57:56 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:57:56</nova:creationTime>
Aug 17 03:57:56 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:57:56 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:57:56 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:57:56 user nova-compute[72793]:       <nova:owner>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:user uuid="3f0cd34800034c5e9729e92f2388700d">tempest-TaggedAttachmentsTest-1633838755-project-member</nova:user>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:project uuid="bfc3fafd6d4541c1be05fc81ca6988dc">tempest-TaggedAttachmentsTest-1633838755</nova:project>
Aug 17 03:57:56 user nova-compute[72793]:       </nova:owner>
Aug 17 03:57:56 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:57:56 user nova-compute[72793]:       <nova:ports>
Aug 17 03:57:56 user nova-compute[72793]:         <nova:port uuid="eb423df8-c512-4db6-8306-988514364769">
Aug 17 03:57:56 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 03:57:56 user nova-compute[72793]:         </nova:port>
Aug 17 03:57:56 user nova-compute[72793]:       </nova:ports>
Aug 17 03:57:56 user nova-compute[72793]:     </nova:instance>
Aug 17 03:57:56 user nova-compute[72793]:   </metadata>
Aug 17 03:57:56 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:57:56 user nova-compute[72793]:     <system>
Aug 17 03:57:56 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:57:56 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:57:56 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:57:56 user nova-compute[72793]:       <entry name="serial">df59fea4-c74f-40c1-bc93-be5085413156</entry>
Aug 17 03:57:56 user nova-compute[72793]:       <entry name="uuid">df59fea4-c74f-40c1-bc93-be5085413156</entry>
Aug 17 03:57:56 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:57:56 user nova-compute[72793]:     </system>
Aug 17 03:57:56 user nova-compute[72793]:   </sysinfo>
Aug 17 03:57:56 user nova-compute[72793]:   <os>
Aug 17 03:57:56 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:57:56 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:57:56 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:57:56 user nova-compute[72793]:   </os>
Aug 17 03:57:56 user nova-compute[72793]:   <features>
Aug 17 03:57:56 user nova-compute[72793]:     <acpi/>
Aug 17 03:57:56 user nova-compute[72793]:     <apic/>
Aug 17 03:57:56 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:57:56 user nova-compute[72793]:   </features>
Aug 17 03:57:56 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:57:56 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:57:56 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:57:56 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:57:56 user nova-compute[72793]:   </clock>
Aug 17 03:57:56 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:57:56 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:57:56 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:57:56 user nova-compute[72793]:   </cpu>
Aug 17 03:57:56 user nova-compute[72793]:   <devices>
Aug 17 03:57:56 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 03:57:56 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 03:57:56 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk"/>
Aug 17 03:57:56 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:57:56 user nova-compute[72793]:     </disk>
Aug 17 03:57:56 user nova-compute[72793]:     <disk type="file" device="cdrom">
Aug 17 03:57:56 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 03:57:56 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.config"/>
Aug 17 03:57:56 user nova-compute[72793]:       <target dev="hda" bus="ide"/>
Aug 17 03:57:56 user nova-compute[72793]:     </disk>
Aug 17 03:57:56 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:57:56 user nova-compute[72793]:       <mac address="fa:16:3e:fc:8d:cc"/>
Aug 17 03:57:56 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:56 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:57:56 user nova-compute[72793]:       <target dev="tapeb423df8-c5"/>
Aug 17 03:57:56 user nova-compute[72793]:     </interface>
Aug 17 03:57:56 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:57:56 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/console.log" append="off"/>
Aug 17 03:57:56 user nova-compute[72793]:     </serial>
Aug 17 03:57:56 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:57:56 user nova-compute[72793]:     <video>
Aug 17 03:57:56 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:57:56 user nova-compute[72793]:     </video>
Aug 17 03:57:56 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:57:56 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:57:56 user nova-compute[72793]:     </rng>
Aug 17 03:57:56 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:57:56 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:57:56 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:57:56 user nova-compute[72793]:     </memballoon>
Aug 17 03:57:56 user nova-compute[72793]:   </devices>
Aug 17 03:57:56 user nova-compute[72793]: </domain>
Aug 17 03:57:56 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG os_vif [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Instance spawned successfully.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid af93423f-79c3-4f93-89ca-32be3c13f74f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb423df8-c5, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb423df8-c5, col_values=(('external_ids', {'iface-id': 'eb423df8-c512-4db6-8306-988514364769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:8d:cc', 'vm-uuid': 'df59fea4-c74f-40c1-bc93-be5085413156'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: INFO os_vif [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5')
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244676.0824194, 706f36b4-71ed-4433-8598-e22a8d47d24a => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] VM Started (Lifecycle Event)
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Instance spawned successfully.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Took 11.36 seconds to spawn the instance on the hypervisor.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244676.3120592, 2f348045-d3ba-409a-b57b-58bbdd86341c => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] VM Resumed (Lifecycle Event)
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No BDM found with device name hda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No VIF found with MAC fa:16:3e:fc:8d:cc, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Using config drive
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244676.3129156, 2f348045-d3ba-409a-b57b-58bbdd86341c => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] VM Started (Lifecycle Event)
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Took 13.01 seconds to spawn the instance on the hypervisor.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Took 13.29 seconds to build instance.
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Creating config drive at /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.config
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzili1rxi {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00023f8c-10db-4afb-88d5-9253da4c1abd tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.487s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzili1rxi" returned: 0 in 0.078s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:57:56 user nova-compute[72793]: INFO nova.compute.manager [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Took 14.38 seconds to build instance.
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cddaee56-bb8f-4ee9-ba9d-571cc5f22ad0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.680s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updating instance_info_cache with network_info: [{"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-af93423f-79c3-4f93-89ca-32be3c13f74f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 03:57:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updated VIF entry in instance network info cache for port eb423df8-c512-4db6-8306-988514364769. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-09935848-62f6-4e09-85c1-d351111b3aca req-56fc87bc-3083-400e-8448-37bc6cca344c service nova] Releasing lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:57:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:57:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244681.2967267, db7dfa83-dd42-427d-9b41-1b308e7448be => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] VM Resumed (Lifecycle Event)
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Instance spawned successfully.
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244681.2974775, db7dfa83-dd42-427d-9b41-1b308e7448be => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] VM Started (Lifecycle Event)
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Took 14.54 seconds to spawn the instance on the hypervisor.
Aug 17 03:58:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:01 user nova-compute[72793]: INFO nova.compute.manager [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Took 15.94 seconds to build instance.
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d5e0021-f8c8-4f6c-99ca-8c8013b35901 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.127s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244682.0014265, 8ef016ce-07e3-4fe1-8b99-29cce6862f55 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] VM Resumed (Lifecycle Event)
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Instance spawned successfully.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244682.0046647, 8ef016ce-07e3-4fe1-8b99-29cce6862f55 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] VM Started (Lifecycle Event)
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Instance spawned successfully.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Took 10.54 seconds to spawn the instance on the hypervisor.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244682.1109421, df59fea4-c74f-40c1-bc93-be5085413156 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] VM Resumed (Lifecycle Event)
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Took 9.78 seconds to spawn the instance on the hypervisor.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244682.1128294, df59fea4-c74f-40c1-bc93-be5085413156 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] VM Started (Lifecycle Event)
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Took 12.05 seconds to build instance.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37a73639-479b-419b-9443-ce9c0580b2d9 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.381s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:02 user nova-compute[72793]: INFO nova.compute.manager [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Took 11.41 seconds to build instance.
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c1ba558-2567-42b0-94aa-10db94b0ac71 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.607s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-7975dfd1-afde-471f-a1d1-caf7338267f8 req-9d6329ef-7d3c-486a-924e-80f7d469b31d service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7975dfd1-afde-471f-a1d1-caf7338267f8 req-9d6329ef-7d3c-486a-924e-80f7d469b31d service nova] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7975dfd1-afde-471f-a1d1-caf7338267f8 req-9d6329ef-7d3c-486a-924e-80f7d469b31d service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7975dfd1-afde-471f-a1d1-caf7338267f8 req-9d6329ef-7d3c-486a-924e-80f7d469b31d service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-7975dfd1-afde-471f-a1d1-caf7338267f8 req-9d6329ef-7d3c-486a-924e-80f7d469b31d service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] No waiting events found dispatching network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:03 user nova-compute[72793]: WARNING nova.compute.manager [req-7975dfd1-afde-471f-a1d1-caf7338267f8 req-9d6329ef-7d3c-486a-924e-80f7d469b31d service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received unexpected event network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 for instance with vm_state active and task_state None.
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] No waiting events found dispatching network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received unexpected event network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 for instance with vm_state active and task_state None.
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] No waiting events found dispatching network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received unexpected event network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 for instance with vm_state active and task_state None.
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] No waiting events found dispatching network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received unexpected event network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 for instance with vm_state active and task_state None.
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] No waiting events found dispatching network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received unexpected event network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 for instance with vm_state active and task_state None.
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] No waiting events found dispatching network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.compute.manager [req-65b6d017-58e8-4917-873e-e1dbddf1cb13 req-2c31bd33-6edb-4635-95c7-5fc6d7ae9810 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received unexpected event network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 for instance with vm_state active and task_state None.
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:58:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7886MB free_disk=25.930370330810547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance af93423f-79c3-4f93-89ca-32be3c13f74f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 2f348045-d3ba-409a-b57b-58bbdd86341c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 706f36b4-71ed-4433-8598-e22a8d47d24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance db7dfa83-dd42-427d-9b41-1b308e7448be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance df59fea4-c74f-40c1-bc93-be5085413156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 03:58:05 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.239s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 03:58:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 03:58:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:58:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:10 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:58:10 user nova-compute[72793]: INFO nova.compute.claims [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Claim successful on node user
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:58:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:58:11 user nova-compute[72793]: INFO nova.virt.block_device [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Booting with volume d2a859f4-3d7c-40d9-a818-e709fd9cf187 at /dev/vda
Aug 17 03:58:11 user nova-compute[72793]: DEBUG nova.policy [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cc25ca429a24dd69d17c141308f8b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509f87a040314d60ab44619f429bf643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:58:11 user nova-compute[72793]: DEBUG os_brick.utils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:58:11 user nova-compute[72793]: INFO oslo.privsep.daemon [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgxq8zrif/privsep.sock']
Aug 17 03:58:11 user sudo[83907]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgxq8zrif/privsep.sock
Aug 17 03:58:11 user sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 03:58:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Successfully created port: 07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Successfully updated port: 07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquired lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-changed-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Refreshing instance network info cache due to event network-changed-07c47f54-74de-4003-bdcd-73f85b27f1e5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] Acquiring lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updating instance_info_cache with network_info: [{"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Releasing lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance network_info: |[{"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] Acquired lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Refreshing network info cache for port 07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:58:13 user sudo[83907]: pam_unix(sudo:session): session closed for user root
Aug 17 03:58:13 user nova-compute[72793]: INFO oslo.privsep.daemon [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Spawned new privsep daemon via rootwrap
Aug 17 03:58:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 03:58:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 03:58:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 03:58:13 user nova-compute[72793]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84011
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa8020a-15fd-4b93-aae8-3e70f68b410d]: (2,) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d45200-993c-44f1-b2c8-f2f8df2fd177]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:13 user nova-compute[72793]: WARNING os_brick.initiator.connectors.nvmeof [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a64c06-dd86-4049-9661-d79c3e49d357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260d7e8-3dbf-4e6c-98c4-5802babb5df4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e96a0b-1017-461f-8fa0-db111cad6684]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updated VIF entry in instance network info cache for port 07c47f54-74de-4003-bdcd-73f85b27f1e5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updating instance_info_cache with network_info: [{"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b3f3f5f5-a8c3-48f3-8c5f-da54d73c1b0a req-fc6158f6-ca15-4982-b1c5-1fd6fb04882a service nova] Releasing lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:58:13 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:58:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd47dd-f978-4736-92e2-22c8b6dae3f6]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG os_brick.utils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== get_connector_properties: return (2270ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:58:13 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updating existing volume attachment record: 63d6c261-088e-4a8b-a4ab-6f5829ed5f3f {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-4da75740-267e-460d-9b6f-b28c6064b5b4 req-85d5ca4d-99ba-4edc-ac38-f7e553e71a3d service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4da75740-267e-460d-9b6f-b28c6064b5b4 req-85d5ca4d-99ba-4edc-ac38-f7e553e71a3d service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4da75740-267e-460d-9b6f-b28c6064b5b4 req-85d5ca4d-99ba-4edc-ac38-f7e553e71a3d service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4da75740-267e-460d-9b6f-b28c6064b5b4 req-85d5ca4d-99ba-4edc-ac38-f7e553e71a3d service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-4da75740-267e-460d-9b6f-b28c6064b5b4 req-85d5ca4d-99ba-4edc-ac38-f7e553e71a3d service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:16 user nova-compute[72793]: WARNING nova.compute.manager [req-4da75740-267e-460d-9b6f-b28c6064b5b4 req-85d5ca4d-99ba-4edc-ac38-f7e553e71a3d service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received unexpected event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with vm_state active and task_state None.
Aug 17 03:58:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:18 user nova-compute[72793]: WARNING nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received unexpected event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with vm_state active and task_state None.
Aug 17 03:58:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:18 user nova-compute[72793]: WARNING nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 for instance with vm_state active and task_state None.
Aug 17 03:58:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:18 user nova-compute[72793]: WARNING nova.compute.manager [req-8e1279c5-3550-408c-aab1-deda9a7b6977 req-ac2c639e-3570-40ee-857b-413164ce741a service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 for instance with vm_state active and task_state None.
Aug 17 03:58:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:58:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Creating image(s)
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Ensure instance console log exists: /opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Start _get_guest_xml network_info=[{"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2a859f4-3d7c-40d9-a818-e709fd9cf187', 'serial': 'd2a859f4-3d7c-40d9-a818-e709fd9cf187'}, 'guest_format': None, 'attachment_id': '63d6c261-088e-4a8b-a4ab-6f5829ed5f3f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:58:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:58:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:58:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connector [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Factory for ISCSI on None {{(pid=72793) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:58:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:58:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:58:25 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0c1194-f33c-44e9-b593-85a170abf2b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:58:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c16526a-5d23-4bc4-afd3-ea8a87a10e9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187] added
Aug 17 03:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[160704d7-a5a5-4e17-9e6b-6aed89d477d8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d696827-b681-41aa-ad7d-2f9aadc06d89]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJhGRykp {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJhGRykp" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6146f-b46b-4117-b71a-290ec66c9334]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJhGRykp'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52fd5a8-e872-4330-a5f0-26282d482855]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d45ad8-0893-40aa-9516-05be564f7a4a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 03:58:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 03:58:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:58:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 03:58:25 user nova-compute[72793]: 
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78c0aa-3f3a-43f8-ae09-6b94b7efc53d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]
Aug 17 03:58:25 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.
Aug 17 03:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdf7e46-e278-47b4-b807-aa675fe2613f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5b0452-1969-4350-ac82-e55cfaa7f49d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3141fa8a-42bf-4516-9a7d-e90a1d21fca2]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23538396237303031', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538396237303031', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-917225422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-917225422',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDlQJCI7rjvlO55Em8P3/L29qbMQcM7TGvwcHeUUvSNLXuhg3UnhsGj5W2Id2HCnfxiEhL7JNP5OzbDmWKx6l92PP088myRaT0v0OING/Z0OZwctCgd6AjAXMkWxDRTog==',key_name='tempest-keypair-2019873661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='509f87a040314d60ab44619f429bf643',ramdisk_id='',reservation_id='r-itn0ol3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-696729334',owner_user_name='tempest-ServerActionsV293TestJSON-696729334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc25ca429a24dd69d17c141308f8b33',uuid=31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converting VIF {"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'pci_devices' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:58:26 user nova-compute[72793]:   <uuid>31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13</uuid>
Aug 17 03:58:26 user nova-compute[72793]:   <name>instance-0000000a</name>
Aug 17 03:58:26 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:58:26 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:58:26 user nova-compute[72793]:   <metadata>
Aug 17 03:58:26 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:58:26 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:58:26 user nova-compute[72793]:       <nova:name>tempest-ServerActionsV293TestJSON-server-917225422</nova:name>
Aug 17 03:58:26 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:58:24</nova:creationTime>
Aug 17 03:58:26 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:58:26 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:58:26 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:58:26 user nova-compute[72793]:       <nova:owner>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:user uuid="8cc25ca429a24dd69d17c141308f8b33">tempest-ServerActionsV293TestJSON-696729334-project-member</nova:user>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:project uuid="509f87a040314d60ab44619f429bf643">tempest-ServerActionsV293TestJSON-696729334</nova:project>
Aug 17 03:58:26 user nova-compute[72793]:       </nova:owner>
Aug 17 03:58:26 user nova-compute[72793]:       <nova:ports>
Aug 17 03:58:26 user nova-compute[72793]:         <nova:port uuid="07c47f54-74de-4003-bdcd-73f85b27f1e5">
Aug 17 03:58:26 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 03:58:26 user nova-compute[72793]:         </nova:port>
Aug 17 03:58:26 user nova-compute[72793]:       </nova:ports>
Aug 17 03:58:26 user nova-compute[72793]:     </nova:instance>
Aug 17 03:58:26 user nova-compute[72793]:   </metadata>
Aug 17 03:58:26 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:58:26 user nova-compute[72793]:     <system>
Aug 17 03:58:26 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:58:26 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:58:26 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:58:26 user nova-compute[72793]:       <entry name="serial">31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13</entry>
Aug 17 03:58:26 user nova-compute[72793]:       <entry name="uuid">31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13</entry>
Aug 17 03:58:26 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:58:26 user nova-compute[72793]:     </system>
Aug 17 03:58:26 user nova-compute[72793]:   </sysinfo>
Aug 17 03:58:26 user nova-compute[72793]:   <os>
Aug 17 03:58:26 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:58:26 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:58:26 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:58:26 user nova-compute[72793]:   </os>
Aug 17 03:58:26 user nova-compute[72793]:   <features>
Aug 17 03:58:26 user nova-compute[72793]:     <acpi/>
Aug 17 03:58:26 user nova-compute[72793]:     <apic/>
Aug 17 03:58:26 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:58:26 user nova-compute[72793]:   </features>
Aug 17 03:58:26 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:58:26 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:58:26 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:58:26 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:58:26 user nova-compute[72793]:   </clock>
Aug 17 03:58:26 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:58:26 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:58:26 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:58:26 user nova-compute[72793]:   </cpu>
Aug 17 03:58:26 user nova-compute[72793]:   <devices>
Aug 17 03:58:26 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 03:58:26 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 03:58:26 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 03:58:26 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:58:26 user nova-compute[72793]:       <serial>d2a859f4-3d7c-40d9-a818-e709fd9cf187</serial>
Aug 17 03:58:26 user nova-compute[72793]:     </disk>
Aug 17 03:58:26 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:58:26 user nova-compute[72793]:       <mac address="fa:16:3e:bc:f0:05"/>
Aug 17 03:58:26 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:58:26 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:58:26 user nova-compute[72793]:       <target dev="tap07c47f54-74"/>
Aug 17 03:58:26 user nova-compute[72793]:     </interface>
Aug 17 03:58:26 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:58:26 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13/console.log" append="off"/>
Aug 17 03:58:26 user nova-compute[72793]:     </serial>
Aug 17 03:58:26 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:58:26 user nova-compute[72793]:     <video>
Aug 17 03:58:26 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:58:26 user nova-compute[72793]:     </video>
Aug 17 03:58:26 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:58:26 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:58:26 user nova-compute[72793]:     </rng>
Aug 17 03:58:26 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:58:26 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:58:26 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:58:26 user nova-compute[72793]:     </memballoon>
Aug 17 03:58:26 user nova-compute[72793]:   </devices>
Aug 17 03:58:26 user nova-compute[72793]: </domain>
Aug 17 03:58:26 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-917225422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-917225422',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDlQJCI7rjvlO55Em8P3/L29qbMQcM7TGvwcHeUUvSNLXuhg3UnhsGj5W2Id2HCnfxiEhL7JNP5OzbDmWKx6l92PP088myRaT0v0OING/Z0OZwctCgd6AjAXMkWxDRTog==',key_name='tempest-keypair-2019873661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='509f87a040314d60ab44619f429bf643',ramdisk_id='',reservation_id='r-itn0ol3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-696729334',owner_user_name='tempest-ServerActionsV293TestJSON-696729334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc25ca429a24dd69d17c141308f8b33',uuid=31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converting VIF {"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG os_vif [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07c47f54-74, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07c47f54-74, col_values=(('external_ids', {'iface-id': '07c47f54-74de-4003-bdcd-73f85b27f1e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:f0:05', 'vm-uuid': '31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:26 user nova-compute[72793]: INFO os_vif [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74')
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:58:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] No VIF found with MAC fa:16:3e:bc:f0:05, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:58:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-cb88f530-b576-4e5a-a428-418769880f95 req-4dc8547f-c8c8-4cca-abeb-7ae65e455398 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cb88f530-b576-4e5a-a428-418769880f95 req-4dc8547f-c8c8-4cca-abeb-7ae65e455398 service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cb88f530-b576-4e5a-a428-418769880f95 req-4dc8547f-c8c8-4cca-abeb-7ae65e455398 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cb88f530-b576-4e5a-a428-418769880f95 req-4dc8547f-c8c8-4cca-abeb-7ae65e455398 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-cb88f530-b576-4e5a-a428-418769880f95 req-4dc8547f-c8c8-4cca-abeb-7ae65e455398 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:28 user nova-compute[72793]: WARNING nova.compute.manager [req-cb88f530-b576-4e5a-a428-418769880f95 req-4dc8547f-c8c8-4cca-abeb-7ae65e455398 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state building and task_state spawning.
Aug 17 03:58:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244710.1942306, 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] VM Resumed (Lifecycle Event)
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance spawned successfully.
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-b06f0799-71eb-4603-bb30-4b4443e840ae req-5d5b2efe-d9d4-4c4b-86b9-36953530ad38 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b06f0799-71eb-4603-bb30-4b4443e840ae req-5d5b2efe-d9d4-4c4b-86b9-36953530ad38 service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b06f0799-71eb-4603-bb30-4b4443e840ae req-5d5b2efe-d9d4-4c4b-86b9-36953530ad38 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b06f0799-71eb-4603-bb30-4b4443e840ae req-5d5b2efe-d9d4-4c4b-86b9-36953530ad38 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-b06f0799-71eb-4603-bb30-4b4443e840ae req-5d5b2efe-d9d4-4c4b-86b9-36953530ad38 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:58:30 user nova-compute[72793]: WARNING nova.compute.manager [req-b06f0799-71eb-4603-bb30-4b4443e840ae req-5d5b2efe-d9d4-4c4b-86b9-36953530ad38 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state building and task_state spawning.
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244710.1954613, 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] VM Started (Lifecycle Event)
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 17 03:58:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:58:30 user nova-compute[72793]: INFO nova.compute.manager [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Took 19.93 seconds to build instance.
Aug 17 03:58:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e8ac3c09-df32-4dca-aac5-bd9bc35d7f67 tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.093s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "23e09e58-5a60-45d5-922a-75e11a206a91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 03:58:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 03:58:48 user nova-compute[72793]: INFO nova.compute.claims [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Claim successful on node user
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:58:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:49 user nova-compute[72793]: INFO nova.virt.block_device [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Booting with volume aa467d95-33e0-4d62-baec-683a6899934c at /dev/vda
Aug 17 03:58:49 user nova-compute[72793]: DEBUG os_brick.utils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.policy [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a13a9af2372e477fb0f90ab7fb5ab009', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1671538ad9d945c9a737c24ca6bb6e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dedb468-b563-4b60-a898-9afd0312678c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b6be2-985e-471f-a742-b923b16232f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b3d5a-8bb5-4746-a602-cccf42d30212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce6e66-a05e-491b-8262-b83b45a0d218]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:58:49 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:58:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b0705-fa8d-4bf2-98cb-e377b21365f8]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG os_brick.utils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:58:49 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating existing volume attachment record: def0b40a-cbc3-48d8-887d-5e005f02fd4e {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:58:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully created port: a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:58:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully created port: e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:58:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully created port: 2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:58:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully created port: 15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:58:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully created port: b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-a5adbf41-9f1b-4946-89d8-69c7518898a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ec496c90-0c8d-497e-bfcf-c93f96a4b404 req-60037e5e-0b15-4d68-a966-3965be2221e4 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-ad01a491-829b-4a1c-aebf-3d53f045ca24. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-d1669186-951c-4eab-aec1-44b9b5fbbc41. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:58:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c72cb1a-1c15-4e74-91a3-167d95b6be59 req-1d74a2d1-85aa-4659-8ac6-8bc8e3e81063 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: 2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-2915ae74-0db0-417a-9361-8ec675e97ebc. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port 2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f61e8549-69c9-4bf9-a846-804da3b7e03c req-0c39aebf-490d-4fee-93cf-533ada824a59 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: 15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-e482381a-523d-457c-bdbd-094ef9848b52. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ed558143-d34c-4d91-b4d7-bcf68e5597c0 req-ff13ec11-712f-4c0e-83f9-4b8498716565 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:58:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Successfully updated port: b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-15c29453-faaa-436f-ad7c-adc113f155ca. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:58:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance network_info: |[{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port 15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updated VIF entry in instance network info cache for port 15c29453-faaa-436f-ad7c-adc113f155ca. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23d65ad6-0b74-49f0-a09c-88c735d642bc req-b4d16209-7ff7-41c0-b0d3-e78511109081 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: INFO nova.virt.block_device [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Booting with volume e05c9f84-999f-48c7-96c0-0bc1cba71f18 at /dev/vdb
Aug 17 03:59:01 user nova-compute[72793]: DEBUG os_brick.utils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e41c1a0-ad9e-482e-9076-f18db643195c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15dcec-4fbf-4bb2-98e5-10c9feccbb4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b877c21-2979-4751-8d25-a7853bddb431]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a238b-47fa-4603-8e23-608be71a0dbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updated VIF entry in instance network info cache for port b8e195ad-1f39-47cf-8a5d-cf1dfbd787be. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d3212af-3e2f-4f71-85b0-34f22fa31df5 req-1b710f99-6c6e-4012-b152-d3da3c97c092 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:01 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa6321-9679-4275-ab76-62080698a41c]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG os_brick.utils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating existing volume attachment record: df7adc9e-9be2-4a4b-a20b-7514966a808c {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:01 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:59:01 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:59:01 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=6959MB free_disk=25.775592803955078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance af93423f-79c3-4f93-89ca-32be3c13f74f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 2f348045-d3ba-409a-b57b-58bbdd86341c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 706f36b4-71ed-4433-8598-e22a8d47d24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance db7dfa83-dd42-427d-9b41-1b308e7448be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance df59fea4-c74f-40c1-bc93-be5085413156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 23e09e58-5a60-45d5-922a-75e11a206a91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 03:59:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lazy-loading 'flavor' on Instance uuid af93423f-79c3-4f93-89ca-32be3c13f74f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-changed-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Refreshing instance network info cache due to event network-changed-fcf0e2da-57d4-4b11-8d5d-4410979612d7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Refreshing network info cache for port fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:04 user nova-compute[72793]: INFO nova.compute.manager [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Attaching volume 9e9eeb29-af02-43c4-92f2-cdc2ac620144 to /dev/vdb
Aug 17 03:59:04 user nova-compute[72793]: DEBUG os_brick.utils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e967ad7-28f2-4461-967d-d9b10d6e0658]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b606824-c8a3-42a2-ac66-567065e1e416]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ebf25-535e-4317-82a0-c49bf6f30a32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e986fad-7890-4386-a769-b3ae6f107ba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:04 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[86afcc4c-90be-48f0-815e-75f759781425]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG os_brick.utils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updating existing volume attachment record: 3c965aa9-40ca-46e2-b361-c2d9ea9813c9 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updated VIF entry in instance network info cache for port fcf0e2da-57d4-4b11-8d5d-4410979612d7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-47f8192b-83c7-44e2-b7fe-aa12e70e66cd req-8bd3dae7-8c79-4b45-a1ce-01beffa2079b service nova] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:12 user nova-compute[72793]: INFO nova.virt.block_device [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Booting with volume 0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 at /dev/vdc
Aug 17 03:59:12 user nova-compute[72793]: DEBUG os_brick.utils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f9311-0feb-4e66-8aa1-c77b9f2cb9ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9cc91-32b9-48ce-a424-81d825a4546f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9edf7e-9af0-471c-a27e-a3bc625e3ff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06355c-a561-486e-9913-56bcf5b6d834]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:12 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f967ce1-9a22-45b8-8201-f14b3621981d]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG os_brick.utils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:12 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating existing volume attachment record: 6fae2a76-7bea-4840-9a3b-01b9e52c338a {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-changed-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Refreshing instance network info cache due to event network-changed-85751269-3e2b-4a54-a738-f2532f5d07b9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Refreshing network info cache for port 85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:17 user nova-compute[72793]: DEBUG nova.network.neutron [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated VIF entry in instance network info cache for port 85751269-3e2b-4a54-a738-f2532f5d07b9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:17 user nova-compute[72793]: DEBUG nova.network.neutron [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d1250c20-d78c-4441-8abf-ffd09765ff83 req-1c4b0227-f7be-4c25-a7e6-45a9692dd01c service nova] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 03:59:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Creating image(s)
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Ensure instance console log exists: /opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Start _get_guest_xml network_info=[{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPkETnVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23e09e58-5a60-45d5-922a-75e11a206a91', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa467d95-33e0-4d62-baec-683a6899934c', 'serial': 'aa467d95-33e0-4d62-baec-683a6899934c'}, 'guest_format': None, 'attachment_id': 'def0b40a-cbc3-48d8-887d-5e005f02fd4e', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLizQwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23e09e58-5a60-45d5-922a-75e11a206a91', 'attached_at': '', 'detached_at': '', 'volume_id': 'e05c9f84-999f-48c7-96c0-0bc1cba71f18', 'serial': 'e05c9f84-999f-48c7-96c0-0bc1cba71f18'}, 'guest_format': None, 'attachment_id': 'df7adc9e-9be2-4a4b-a20b-7514966a808c', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRyBCYsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23e09e58-5a60-45d5-922a-75e11a206a91', 'attached_at': '', 'detached_at': '', 'volume_id': '0bc5e8dd-a3d4-49a3-ad32-7880636d2c24', 'serial': '0bc5e8dd-a3d4-49a3-ad32-7880636d2c24'}, 'guest_format': None, 'attachment_id': '6fae2a76-7bea-4840-9a3b-01b9e52c338a', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 03:59:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:59:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPkETnVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:24 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa13d5-fe41-40ac-b3bc-e43839a859f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:59:24 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967973b-8306-4485-8a16-9f6c70c61983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c] added
Aug 17 03:59:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4468d99a-a181-44e7-8152-ef77ee62cdaa]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b6356-44da-4068-b3a5-6b586f608a77]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPkETnVu {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tPkETnVu" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f726a5db-0905-444c-be0b-e2e1d01c4ce3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tPkETnVu'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c659bf0c-3ead-468e-94d7-788f32f7f9d0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d26d77-ce02-4cf3-896e-d070b11dcdea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7148d5-0188-4795-8fc4-37def140ebad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260]
Aug 17 03:59:24 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d82cb-86da-4ce7-81fe-8cde7dc2ade1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdfc054-5276-46ca-9dd8-6386d7b38617]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:24 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:24 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baabadd-d5e8-4750-be8a-da79d7ea0d12]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:59:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPkETnVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26565326164303034', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565326164303034', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLizQwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:25 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[101d22d6-dbba-42ce-8bfd-898c068bf848]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:59:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979958a-fc3a-430a-b780-ea267d191460]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18] added
Aug 17 03:59:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[43beee4e-600f-499b-8656-22f484bc8e68]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e840b1c4-29c5-4020-9602-394a32f7aa8a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scLizQwj {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scLizQwj" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbdee75-688c-400f-adb5-f59b49a39b9e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scLizQwj'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0915909-d478-48e8-982b-25f09af15d5d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e18dc4-282e-4d16-a529-6f357c54f94b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:25 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:25 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e415e-31c2-4eb0-b3c1-757c952d1441]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260]
Aug 17 03:59:25 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[519c261f-f0af-485a-884f-590c32fc3c84]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cff0c2-3a2e-4a7e-90f7-86675a8f3115]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:25 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:25 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:25 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:25 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ceaa9d4-2175-4774-9a02-3002de508ce2]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:59:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLizQwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUzDhtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:26 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23361633265343138', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361633265343138', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.872s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:26 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:26 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:59:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRyBCYsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:27 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd232e3-2d64-4459-87b1-f3a1bbc6c605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:59:27 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fd8ff7-9df7-4a8e-827c-8838f4647e33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144] added
Aug 17 03:59:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[00974d52-06a1-4995-bde8-23a68ec822f4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[66065fe8-33bf-487f-991b-b0f2868e24d2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcUzDhtR {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcUzDhtR" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d686f09-7b5c-4dc2-b37f-613ef46a70cc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcUzDhtR'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15a224f-3576-4577-b6b6-f1c487c72547]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f84a21-0380-452c-9fa2-65e2d79c3945]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a62ae7-b4c2-4b4d-90c7-6c08531b61bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260]
Aug 17 03:59:27 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc09b08-5cd5-46bf-b3a6-e0747e3e8231]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[346555ae-15c3-483f-89fc-f9a25c806fb2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c074430d-c42c-47d0-a268-d59bec57e207]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:59:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUzDhtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] <== connect_volume: return (2196ms) {'type': 'block', 'scsi_wwn': '26337303935353137', 'path': '/dev/sde'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337303935353137', 'path': '/dev/sde'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.300s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:28 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG nova.objects.instance [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lazy-loading 'flavor' on Instance uuid af93423f-79c3-4f93-89ca-32be3c13f74f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[53de0fc0-f084-48c5-b9bd-da8ec1af8e41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:59:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 03:59:28 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 03:59:28 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 03:59:28 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 03:59:28 user nova-compute[72793]:   <serial>9e9eeb29-af02-43c4-92f2-cdc2ac620144</serial>
Aug 17 03:59:28 user nova-compute[72793]: </disk>
Aug 17 03:59:28 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e5717f-96f4-4422-89e9-411f81fb3cc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24] added
Aug 17 03:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6821631-c123-4463-874d-858bc8b0fd4f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b142391-21f2-4a17-9fcb-a9cb19aa6328]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRyBCYsz {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JRyBCYsz" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a4ace5-1041-4706-855e-120e54615933]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JRyBCYsz'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9309bb6-752e-4da8-be9e-638f861b4cf3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[45746e86-16a0-44fc-9c43-ce9f34957853]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56e9e7f-e85e-468a-add6-f122c399f6d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260]
Aug 17 03:59:28 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4662e6-be01-4ced-b2cc-9fef35183c94]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5451e116-4e46-4229-98fa-fd94a5b5a726]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae952489-47aa-4110-a32f-5ebd3f056aa4]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRyBCYsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] No VIF found with MAC fa:16:3e:8f:d6:75, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-abdd5deb-5380-4fad-aa75-01ddbfa40059 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.703s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:29 user nova-compute[72793]: INFO nova.compute.manager [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Terminating instance
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-79e19685-23f1-483a-a4fe-a4fd804a946b req-5dbe0367-44d8-4200-8930-ac108cb8e1d7 service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-vif-unplugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79e19685-23f1-483a-a4fe-a4fd804a946b req-5dbe0367-44d8-4200-8930-ac108cb8e1d7 service nova] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79e19685-23f1-483a-a4fe-a4fd804a946b req-5dbe0367-44d8-4200-8930-ac108cb8e1d7 service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79e19685-23f1-483a-a4fe-a4fd804a946b req-5dbe0367-44d8-4200-8930-ac108cb8e1d7 service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-79e19685-23f1-483a-a4fe-a4fd804a946b req-5dbe0367-44d8-4200-8930-ac108cb8e1d7 service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] No waiting events found dispatching network-vif-unplugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-79e19685-23f1-483a-a4fe-a4fd804a946b req-5dbe0367-44d8-4200-8930-ac108cb8e1d7 service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-vif-unplugged-df034dbc-5143-41fb-8ed9-44afac950ce8 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== connect_volume: return (2626ms) {'type': 'block', 'scsi_wwn': '23932653838363366', 'path': '/dev/sdf'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932653838363366', 'path': '/dev/sdf'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lazy-loading 'pci_devices' on Instance uuid 23e09e58-5a60-45d5-922a-75e11a206a91 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] End _get_guest_xml xml=<domain type="kvm">
Aug 17 03:59:29 user nova-compute[72793]:   <uuid>23e09e58-5a60-45d5-922a-75e11a206a91</uuid>
Aug 17 03:59:29 user nova-compute[72793]:   <name>instance-0000000b</name>
Aug 17 03:59:29 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 03:59:29 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 03:59:29 user nova-compute[72793]:   <metadata>
Aug 17 03:59:29 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:59:29 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 03:59:29 user nova-compute[72793]:       <nova:name>tempest-device-tagging-server-1567675813</nova:name>
Aug 17 03:59:29 user nova-compute[72793]:       <nova:creationTime>2023-08-17 03:59:24</nova:creationTime>
Aug 17 03:59:29 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 03:59:29 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 03:59:29 user nova-compute[72793]:       </nova:flavor>
Aug 17 03:59:29 user nova-compute[72793]:       <nova:owner>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:user uuid="a13a9af2372e477fb0f90ab7fb5ab009">tempest-TaggedBootDevicesTest-1361443360-project-member</nova:user>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:project uuid="1671538ad9d945c9a737c24ca6bb6e7e">tempest-TaggedBootDevicesTest-1361443360</nova:project>
Aug 17 03:59:29 user nova-compute[72793]:       </nova:owner>
Aug 17 03:59:29 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:59:29 user nova-compute[72793]:       <nova:ports>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="a5adbf41-9f1b-4946-89d8-69c7518898a7">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="ad01a491-829b-4a1c-aebf-3d53f045ca24">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="d1669186-951c-4eab-aec1-44b9b5fbbc41">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="e482381a-523d-457c-bdbd-094ef9848b52">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="2915ae74-0db0-417a-9361-8ec675e97ebc">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="15c29453-faaa-436f-ad7c-adc113f155ca">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:         <nova:port uuid="b8e195ad-1f39-47cf-8a5d-cf1dfbd787be">
Aug 17 03:59:29 user nova-compute[72793]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 03:59:29 user nova-compute[72793]:         </nova:port>
Aug 17 03:59:29 user nova-compute[72793]:       </nova:ports>
Aug 17 03:59:29 user nova-compute[72793]:     </nova:instance>
Aug 17 03:59:29 user nova-compute[72793]:   </metadata>
Aug 17 03:59:29 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 03:59:29 user nova-compute[72793]:     <system>
Aug 17 03:59:29 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 03:59:29 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 03:59:29 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 03:59:29 user nova-compute[72793]:       <entry name="serial">23e09e58-5a60-45d5-922a-75e11a206a91</entry>
Aug 17 03:59:29 user nova-compute[72793]:       <entry name="uuid">23e09e58-5a60-45d5-922a-75e11a206a91</entry>
Aug 17 03:59:29 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 03:59:29 user nova-compute[72793]:     </system>
Aug 17 03:59:29 user nova-compute[72793]:   </sysinfo>
Aug 17 03:59:29 user nova-compute[72793]:   <os>
Aug 17 03:59:29 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 03:59:29 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 03:59:29 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 03:59:29 user nova-compute[72793]:   </os>
Aug 17 03:59:29 user nova-compute[72793]:   <features>
Aug 17 03:59:29 user nova-compute[72793]:     <acpi/>
Aug 17 03:59:29 user nova-compute[72793]:     <apic/>
Aug 17 03:59:29 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 03:59:29 user nova-compute[72793]:   </features>
Aug 17 03:59:29 user nova-compute[72793]:   <clock offset="utc">
Aug 17 03:59:29 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 03:59:29 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 03:59:29 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 03:59:29 user nova-compute[72793]:   </clock>
Aug 17 03:59:29 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 03:59:29 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 03:59:29 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 03:59:29 user nova-compute[72793]:   </cpu>
Aug 17 03:59:29 user nova-compute[72793]:   <devices>
Aug 17 03:59:29 user nova-compute[72793]:     <disk type="file" device="cdrom">
Aug 17 03:59:29 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 03:59:29 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91/disk.config"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="hda" bus="ide"/>
Aug 17 03:59:29 user nova-compute[72793]:     </disk>
Aug 17 03:59:29 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 03:59:29 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 03:59:29 user nova-compute[72793]:       <source dev="/dev/sdc"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <serial>aa467d95-33e0-4d62-baec-683a6899934c</serial>
Aug 17 03:59:29 user nova-compute[72793]:     </disk>
Aug 17 03:59:29 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 03:59:29 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 03:59:29 user nova-compute[72793]:       <source dev="/dev/sdd"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <serial>e05c9f84-999f-48c7-96c0-0bc1cba71f18</serial>
Aug 17 03:59:29 user nova-compute[72793]:     </disk>
Aug 17 03:59:29 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 03:59:29 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 03:59:29 user nova-compute[72793]:       <source dev="/dev/sdf"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="vdc" bus="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <serial>0bc5e8dd-a3d4-49a3-ad32-7880636d2c24</serial>
Aug 17 03:59:29 user nova-compute[72793]:     </disk>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:90:e4:b2"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tapa5adbf41-9f"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:dd:e5:da"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tapad01a491-82"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:bb:7b:b4"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tapd1669186-95"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:49:3b:ad"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tape482381a-52"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:18:f9:1b"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tap2915ae74-0d"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:45:ab:71"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tap15c29453-fa"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 03:59:29 user nova-compute[72793]:       <mac address="fa:16:3e:58:f6:b6"/>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 03:59:29 user nova-compute[72793]:       <target dev="tapb8e195ad-1f"/>
Aug 17 03:59:29 user nova-compute[72793]:     </interface>
Aug 17 03:59:29 user nova-compute[72793]:     <serial type="pty">
Aug 17 03:59:29 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91/console.log" append="off"/>
Aug 17 03:59:29 user nova-compute[72793]:     </serial>
Aug 17 03:59:29 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 03:59:29 user nova-compute[72793]:     <video>
Aug 17 03:59:29 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 03:59:29 user nova-compute[72793]:     </video>
Aug 17 03:59:29 user nova-compute[72793]:     <rng model="virtio">
Aug 17 03:59:29 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 03:59:29 user nova-compute[72793]:     </rng>
Aug 17 03:59:29 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 03:59:29 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 03:59:29 user nova-compute[72793]:       <stats period="10"/>
Aug 17 03:59:29 user nova-compute[72793]:     </memballoon>
Aug 17 03:59:29 user nova-compute[72793]:   </devices>
Aug 17 03:59:29 user nova-compute[72793]: </domain>
Aug 17 03:59:29 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5adbf41-9f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5adbf41-9f, col_values=(('external_ids', {'iface-id': 'a5adbf41-9f1b-4946-89d8-69c7518898a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:e4:b2', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f')
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad01a491-82, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad01a491-82, col_values=(('external_ids', {'iface-id': 'ad01a491-829b-4a1c-aebf-3d53f045ca24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:e5:da', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82')
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1669186-95, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1669186-95, col_values=(('external_ids', {'iface-id': 'd1669186-951c-4eab-aec1-44b9b5fbbc41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:7b:b4', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95')
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape482381a-52, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape482381a-52, col_values=(('external_ids', {'iface-id': 'e482381a-523d-457c-bdbd-094ef9848b52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:3b:ad', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52')
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2915ae74-0d, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2915ae74-0d, col_values=(('external_ids', {'iface-id': '2915ae74-0db0-417a-9361-8ec675e97ebc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:f9:1b', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d')
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15c29453-fa, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15c29453-fa, col_values=(('external_ids', {'iface-id': '15c29453-faaa-436f-ad7c-adc113f155ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:ab:71', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Instance destroyed successfully.
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lazy-loading 'resources' on Instance uuid af93423f-79c3-4f93-89ca-32be3c13f74f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-868964321',display_name='tempest-DeleteServersTestJSON-server-868964321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-868964321',id=1,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdafd60dcec74aa1a0c0b01a5a583a89',ramdisk_id='',reservation_id='r-om04jbnx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1235844610',owner_user_name='tempest-DeleteServersTestJSON-1235844610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:57:27Z,user_data=None,user_id='d095effb4184494d8208d699503518e3',uuid=af93423f-79c3-4f93-89ca-32be3c13f74f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Converting VIF {"id": "df034dbc-5143-41fb-8ed9-44afac950ce8", "address": "fa:16:3e:8f:d6:75", "network": {"id": "f630d626-8cb5-44eb-a64d-5a3c40e432b4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1492967671-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdafd60dcec74aa1a0c0b01a5a583a89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf034dbc-51", "ovs_interfaceid": "df034dbc-5143-41fb-8ed9-44afac950ce8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_vif [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa')
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T03:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf034dbc-51, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:30 user nova-compute[72793]: INFO os_vif [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:d6:75,bridge_name='br-int',has_traffic_filtering=True,id=df034dbc-5143-41fb-8ed9-44afac950ce8,network=Network(f630d626-8cb5-44eb-a64d-5a3c40e432b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf034dbc-51')
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8e195ad-1f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8e195ad-1f, col_values=(('external_ids', {'iface-id': 'b8e195ad-1f39-47cf-8a5d-cf1dfbd787be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:f6:b6', 'vm-uuid': '23e09e58-5a60-45d5-922a-75e11a206a91'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcUzDhtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:30 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24b8c66-6692-4490-aac3-3ddd55db8556]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf59fe3e-f317-4f9c-9bf8-26929b3e34d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f0248e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144'): ({'sde'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Removing single pathed devices sde {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:30 user nova-compute[72793]: INFO os_vif [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f')
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f10d805-0489-4435-bca1-d655fa5dc1de]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c090b4c-4ccc-46ff-9433-7d09b5bc7191]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Flushing IO for device /dev/sde {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0340850a-3536-4ce3-b69f-17a1b1964a2d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] No BDM found with device name hda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] No VIF found with MAC fa:16:3e:90:e4:b2, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] No VIF found with MAC fa:16:3e:18:f9:1b, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Using config drive
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea41b30a-e20c-45a9-8d9e-7a99c9639322]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec42201-da17-430e-a7ed-454993af7224]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Creating config drive at /opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91/disk.config
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn5qg5sj5 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971f9a6-3218-4e02-9c34-f60d1c65b5df]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260]
Aug 17 03:59:30 user nova-compute[72793]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn5qg5sj5" returned: 0 in 0.052s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e9eeb29-af02-43c4-92f2-cdc2ac620144 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f101e2-c8ce-43fa-acd0-816bb7cb7fd5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] <== disconnect_volume: return (350ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Deleting instance files /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f_del
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Deletion of /opt/stack/data/nova/instances/af93423f-79c3-4f93-89ca-32be3c13f74f_del complete
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72793) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.virt.libvirt.host [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] UEFI support detected
Aug 17 03:59:30 user nova-compute[72793]: INFO nova.compute.manager [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-changed-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Refreshing instance network info cache due to event network-changed-1882c318-973b-4db1-940f-1e0613b27897. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] Acquiring lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] Acquired lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:30 user nova-compute[72793]: DEBUG nova.network.neutron [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Refreshing network info cache for port 1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:31 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Took 0.67 seconds to deallocate network for instance.
Aug 17 03:59:31 user nova-compute[72793]: DEBUG nova.network.neutron [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updated VIF entry in instance network info cache for port 1882c318-973b-4db1-940f-1e0613b27897. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG nova.network.neutron [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating instance_info_cache with network_info: [{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4691b99c-fc4e-4257-8047-a553a5c04b0d req-6f783d58-a317-4332-b92c-026f750f9162 service nova] Releasing lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] Acquiring lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] No waiting events found dispatching network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:31 user nova-compute[72793]: WARNING nova.compute.manager [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received unexpected event network-vif-plugged-df034dbc-5143-41fb-8ed9-44afac950ce8 for instance with vm_state active and task_state deleting.
Aug 17 03:59:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-385ed6fa-0469-4322-8369-dc385484ee44 req-35e062e9-6952-4a0b-abc6-56793690402d service nova] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Received event network-vif-deleted-df034dbc-5143-41fb-8ed9-44afac950ce8 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3578d781-0e90-4a82-b2b6-e89ac5d37f22 req-553934da-41d0-4a76-9d6e-405752fd2c54 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3578d781-0e90-4a82-b2b6-e89ac5d37f22 req-553934da-41d0-4a76-9d6e-405752fd2c54 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3578d781-0e90-4a82-b2b6-e89ac5d37f22 req-553934da-41d0-4a76-9d6e-405752fd2c54 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3578d781-0e90-4a82-b2b6-e89ac5d37f22 req-553934da-41d0-4a76-9d6e-405752fd2c54 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3578d781-0e90-4a82-b2b6-e89ac5d37f22 req-553934da-41d0-4a76-9d6e-405752fd2c54 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3578d781-0e90-4a82-b2b6-e89ac5d37f22 req-553934da-41d0-4a76-9d6e-405752fd2c54 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 for instance with vm_state building and task_state spawning.
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-be022971-e266-4607-a8a3-e00b84ccf9e9 req-7ce4e91a-26ce-4a3c-8e01-f3ea5998c00e service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-be022971-e266-4607-a8a3-e00b84ccf9e9 req-7ce4e91a-26ce-4a3c-8e01-f3ea5998c00e service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-be022971-e266-4607-a8a3-e00b84ccf9e9 req-7ce4e91a-26ce-4a3c-8e01-f3ea5998c00e service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-be022971-e266-4607-a8a3-e00b84ccf9e9 req-7ce4e91a-26ce-4a3c-8e01-f3ea5998c00e service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-be022971-e266-4607-a8a3-e00b84ccf9e9 req-7ce4e91a-26ce-4a3c-8e01-f3ea5998c00e service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:33 user nova-compute[72793]: WARNING nova.compute.manager [req-be022971-e266-4607-a8a3-e00b84ccf9e9 req-7ce4e91a-26ce-4a3c-8e01-f3ea5998c00e service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 for instance with vm_state building and task_state spawning.
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-changed-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Refreshing instance network info cache due to event network-changed-dfcb202e-d8ad-4753-9251-88500aa6ac09. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] Acquiring lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] Acquired lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG nova.network.neutron [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Refreshing network info cache for port dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lazy-loading 'flavor' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:34 user nova-compute[72793]: WARNING nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 for instance with vm_state building and task_state spawning.
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:34 user nova-compute[72793]: WARNING nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 for instance with vm_state building and task_state spawning.
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:34 user nova-compute[72793]: WARNING nova.compute.manager [req-dc636c26-7fe0-44b3-a72d-6852b6854f5a req-bee85a54-c009-4e81-bceb-3b552e5be2c2 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 for instance with vm_state building and task_state spawning.
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.network.neutron [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Updated VIF entry in instance network info cache for port dfcb202e-d8ad-4753-9251-88500aa6ac09. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.network.neutron [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Updating instance_info_cache with network_info: [{"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-638d1402-45a4-4fdb-b9bc-cf9298a0266b req-2825d325-b8e2-4674-9a55-618b3b90b6db service nova] Releasing lock "refresh_cache-2f348045-d3ba-409a-b57b-58bbdd86341c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:34 user nova-compute[72793]: INFO nova.compute.manager [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Attaching volume 8bdb328e-9d52-4bf3-9345-ecf04be33026 to /dev/vdb
Aug 17 03:59:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a08abd0-737a-4c9e-9945-c3028f96ad60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c369c8-2ab3-46cf-95a0-cc24dd1c8fe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[021a6da5-1e8c-4ee4-aed3-6de63ad85569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8febf3c2-fa62-454f-a0e1-48b990953abf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:34 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbdb2d8-9961-4ae3-82b2-0cd98b3e4d4d]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:34 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Updating existing volume attachment record: 036dac99-6e73-4374-802a-78e344d59fbf {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:35 user nova-compute[72793]: WARNING nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 for instance with vm_state building and task_state spawning.
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:35 user nova-compute[72793]: WARNING nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 for instance with vm_state building and task_state spawning.
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:35 user nova-compute[72793]: WARNING nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 for instance with vm_state building and task_state spawning.
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:35 user nova-compute[72793]: WARNING nova.compute.manager [req-ca78df37-67ff-4887-a9c0-4b3de280937a req-d66400bf-de46-4186-b5c3-c3cf345b8879 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc for instance with vm_state building and task_state spawning.
Aug 17 03:59:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:35 user nova-compute[72793]: WARNING nova.compute.manager [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca for instance with vm_state building and task_state spawning.
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:35 user nova-compute[72793]: WARNING nova.compute.manager [req-75c5b811-9dca-4a93-be3b-645b17ae71ac req-e363a059-02b9-41ce-83d7-5f51cc235790 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca for instance with vm_state building and task_state spawning.
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Took 4.70 seconds to detach 1 volumes for instance.
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244776.3582163, 23e09e58-5a60-45d5-922a-75e11a206a91 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] VM Resumed (Lifecycle Event)
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance spawned successfully.
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244776.3586426, 23e09e58-5a60-45d5-922a-75e11a206a91 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] VM Started (Lifecycle Event)
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Took 12.25 seconds to spawn the instance on the hypervisor.
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.objects.instance [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'flavor' on Instance uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Terminating instance
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Took 47.79 seconds to build instance.
Aug 17 03:59:36 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c2884a2c-8f59-47c7-9afa-2afa66c81ffe tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "23e09e58-5a60-45d5-922a-75e11a206a91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.901s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Deleted allocations for instance af93423f-79c3-4f93-89ca-32be3c13f74f
Aug 17 03:59:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:36 user nova-compute[72793]: INFO nova.compute.manager [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Attaching volume d3ae77aa-2557-4d6e-b7da-448b89e4fe0a to /dev/vdb
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7372f4a5-e417-4edc-8ba5-f186a0fab3a3 tempest-DeleteServersTestJSON-1235844610 tempest-DeleteServersTestJSON-1235844610-project-member] Lock "af93423f-79c3-4f93-89ca-32be3c13f74f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.742s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG os_brick.utils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f58cbc3-d352-4834-9c2e-bb419a6e1cea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98609a3-4ce3-4339-a250-ec9e6a1dccb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b878847-cbb1-4b3b-86da-2928038b3daa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3178e3c7-cfbb-46fe-8035-318b2ef549b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:37 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa35ea01-8bd2-4c46-b70a-7d497320ebba]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG os_brick.utils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating existing volume attachment record: 912a7fcd-74e4-4481-8198-ded7f6af2b0a {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-changed-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Refreshing instance network info cache due to event network-changed-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Acquiring lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Acquired lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.network.neutron [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Refreshing network info cache for port 6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Instance destroyed successfully.
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lazy-loading 'resources' on Instance uuid db7dfa83-dd42-427d-9b41-1b308e7448be {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-226713068',display_name='tempest-VolumesActionsTest-instance-226713068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-226713068',id=7,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='163e4f83cf6c496daaefcf07f2458334',ramdisk_id='',reservation_id='r-e7c30kdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2053759356',owner_user_name='tempest-VolumesActionsTest-2053759356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data=None,user_id='b417e88ac27f494997b2d548630a4799',uuid=db7dfa83-dd42-427d-9b41-1b308e7448be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converting VIF {"id": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "address": "fa:16:3e:8a:ff:dd", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb755de37-76", "ovs_interfaceid": "b755de37-76d7-4b63-951c-f8e9d7449f0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG os_vif [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb755de37-76, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 03:59:37 user nova-compute[72793]: INFO os_vif [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ff:dd,bridge_name='br-int',has_traffic_filtering=True,id=b755de37-76d7-4b63-951c-f8e9d7449f0d,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb755de37-76')
Aug 17 03:59:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Deleting instance files /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be_del
Aug 17 03:59:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Deletion of /opt/stack/data/nova/instances/db7dfa83-dd42-427d-9b41-1b308e7448be_del complete
Aug 17 03:59:37 user nova-compute[72793]: INFO nova.compute.manager [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.network.neutron [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updated VIF entry in instance network info cache for port 6e64c7aa-cb61-4d85-92cf-f7bb30cfc176. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.network.neutron [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updating instance_info_cache with network_info: [{"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Releasing lock "refresh_cache-706f36b4-71ed-4433-8598-e22a8d47d24a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:37 user nova-compute[72793]: WARNING nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc for instance with vm_state active and task_state None.
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:37 user nova-compute[72793]: WARNING nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be for instance with vm_state active and task_state None.
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:37 user nova-compute[72793]: WARNING nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be for instance with vm_state active and task_state None.
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-unplugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-unplugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a6354b8-7e82-4cf4-a05d-ebdad8746e8e req-3acf058b-009c-4c8f-89ed-6bf7375c9abf service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-unplugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:38 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Took 0.69 seconds to deallocate network for instance.
Aug 17 03:59:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-201fa44a-d97d-40dc-a683-bcdca7c59c12 req-3ffca175-9f6d-4620-905f-d7081cc4c121 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-deleted-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:38 user nova-compute[72793]: INFO nova.compute.manager [req-201fa44a-d97d-40dc-a683-bcdca7c59c12 req-3ffca175-9f6d-4620-905f-d7081cc4c121 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Neutron deleted interface b755de37-76d7-4b63-951c-f8e9d7449f0d; detaching it from the instance and deleting it from the info cache
Aug 17 03:59:38 user nova-compute[72793]: DEBUG nova.network.neutron [req-201fa44a-d97d-40dc-a683-bcdca7c59c12 req-3ffca175-9f6d-4620-905f-d7081cc4c121 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-201fa44a-d97d-40dc-a683-bcdca7c59c12 req-3ffca175-9f6d-4620-905f-d7081cc4c121 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Detach interface failed, port_id=b755de37-76d7-4b63-951c-f8e9d7449f0d, reason: Instance db7dfa83-dd42-427d-9b41-1b308e7448be could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 03:59:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:38 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Deleted allocations for instance db7dfa83-dd42-427d-9b41-1b308e7448be
Aug 17 03:59:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a17567ed-b82e-49fc-bc7f-28bd40922313 tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:39 user nova-compute[72793]: WARNING nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received unexpected event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with vm_state deleted and task_state None.
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:39 user nova-compute[72793]: WARNING nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received unexpected event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with vm_state deleted and task_state None.
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:39 user nova-compute[72793]: WARNING nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received unexpected event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with vm_state deleted and task_state None.
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Acquiring lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] Lock "db7dfa83-dd42-427d-9b41-1b308e7448be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] No waiting events found dispatching network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:39 user nova-compute[72793]: WARNING nova.compute.manager [req-9adfd355-07a2-48da-96ab-df1a513961de req-538672e7-83f4-4745-bd04-e6dccd58d330 service nova] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Received unexpected event network-vif-plugged-b755de37-76d7-4b63-951c-f8e9d7449f0d for instance with vm_state deleted and task_state None.
Aug 17 03:59:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lazy-loading 'flavor' on Instance uuid 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-changed-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Refreshing instance network info cache due to event network-changed-defbfa96-c0e2-4651-9ac4-3bff083973d0. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] Acquiring lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] Acquired lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Refreshing network info cache for port defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:41 user nova-compute[72793]: INFO nova.compute.manager [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Attaching volume db8f63f0-709f-42ee-b63a-afe848bfbca8 to /dev/sdc
Aug 17 03:59:41 user nova-compute[72793]: DEBUG os_brick.utils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa980a-4099-401d-b6fe-0d8ea9b1ef14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3af2e7-690b-48e5-9825-4c56d93de0c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f698ffb-2710-4f74-a461-d954bee0eb2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9823f060-52c1-448d-a5c9-5df167c0ea7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lazy-loading 'flavor' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:41 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[098a7aff-4301-4500-bb88-0768434e9f91]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG os_brick.utils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updating existing volume attachment record: 5a4199a1-d44a-4b33-96e8-ef5d0ff46b6d {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updated VIF entry in instance network info cache for port defbfa96-c0e2-4651-9ac4-3bff083973d0. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updating instance_info_cache with network_info: [{"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-00ac2b63-b41a-46b9-ba0d-1cca29f03933 req-8d6738fe-f70a-40a6-969e-1b6885ae16aa service nova] Releasing lock "refresh_cache-8ef016ce-07e3-4fe1-8b99-29cce6862f55" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-changed-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Refreshing instance network info cache due to event network-changed-eb423df8-c512-4db6-8306-988514364769. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] Acquiring lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] Acquired lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:42 user nova-compute[72793]: DEBUG nova.network.neutron [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Refreshing network info cache for port eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "interface-df59fea4-c74f-40c1-bc93-be5085413156-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "interface-df59fea4-c74f-40c1-bc93-be5085413156-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.objects.instance [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'flavor' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updated VIF entry in instance network info cache for port eb423df8-c512-4db6-8306-988514364769. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3d46b9fc-8328-4875-95b7-815abce5e28c req-f0169083-2dc5-4daa-91f9-c0d223bcc40b service nova] Releasing lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.objects.instance [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'pci_requests' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.policy [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f0cd34800034c5e9729e92f2388700d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3fafd6d4541c1be05fc81ca6988dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 03:59:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Successfully created port: 4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Successfully updated port: 4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquired lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-changed-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Refreshing instance network info cache due to event network-changed-4d098c01-4414-49b6-afac-022f3e6b3bdd. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 03:59:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] Acquiring lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244770.009234, af93423f-79c3-4f93-89ca-32be3c13f74f => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:59:45 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] VM Stopped (Lifecycle Event)
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9ff7bd6a-862c-415d-bc09-09a08aacc93e None None] [instance: af93423f-79c3-4f93-89ca-32be3c13f74f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Releasing lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] Acquired lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Refreshing network info cache for port 4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG os_vif [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d098c01-44, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d098c01-44, col_values=(('external_ids', {'iface-id': '4d098c01-4414-49b6-afac-022f3e6b3bdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:3e:11', 'vm-uuid': 'df59fea4-c74f-40c1-bc93-be5085413156'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:45 user nova-compute[72793]: INFO os_vif [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44')
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] attach device xml: <interface type="ethernet">
Aug 17 03:59:45 user nova-compute[72793]:   <mac address="fa:16:3e:7f:3e:11"/>
Aug 17 03:59:45 user nova-compute[72793]:   <model type="virtio"/>
Aug 17 03:59:45 user nova-compute[72793]:   <mtu size="1442"/>
Aug 17 03:59:45 user nova-compute[72793]:   <target dev="tap4d098c01-44"/>
Aug 17 03:59:45 user nova-compute[72793]: </interface>
Aug 17 03:59:45 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-dfe2a088-9e22-4b30-be68-b7f9e93d1cd2 req-2b8974c1-168e-4b1a-8391-6779bccc56d9 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dfe2a088-9e22-4b30-be68-b7f9e93d1cd2 req-2b8974c1-168e-4b1a-8391-6779bccc56d9 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dfe2a088-9e22-4b30-be68-b7f9e93d1cd2 req-2b8974c1-168e-4b1a-8391-6779bccc56d9 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dfe2a088-9e22-4b30-be68-b7f9e93d1cd2 req-2b8974c1-168e-4b1a-8391-6779bccc56d9 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-dfe2a088-9e22-4b30-be68-b7f9e93d1cd2 req-2b8974c1-168e-4b1a-8391-6779bccc56d9 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:46 user nova-compute[72793]: WARNING nova.compute.manager [req-dfe2a088-9e22-4b30-be68-b7f9e93d1cd2 req-2b8974c1-168e-4b1a-8391-6779bccc56d9 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd for instance with vm_state active and task_state None.
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.network.neutron [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updated VIF entry in instance network info cache for port 4d098c01-4414-49b6-afac-022f3e6b3bdd. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.network.neutron [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23fb4af6-21c0-4f3e-8bdf-75aaa72477f4 req-beb59259-53a5-41d3-b138-7fa0936b41bf service nova] Releasing lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No BDM found with device name hda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No VIF found with MAC fa:16:3e:fc:8d:cc, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 03:59:46 user nova-compute[72793]:   <nova:package version="0.0.0"/>
Aug 17 03:59:46 user nova-compute[72793]:   <nova:name>tempest-device-tagging-server-1405185482</nova:name>
Aug 17 03:59:46 user nova-compute[72793]:   <nova:creationTime>2023-08-17 03:59:46</nova:creationTime>
Aug 17 03:59:46 user nova-compute[72793]:   <nova:flavor name="m1.tiny">
Aug 17 03:59:46 user nova-compute[72793]:     <nova:memory>512</nova:memory>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:disk>1</nova:disk>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:swap>0</nova:swap>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:vcpus>1</nova:vcpus>
Aug 17 03:59:46 user nova-compute[72793]:   </nova:flavor>
Aug 17 03:59:46 user nova-compute[72793]:   <nova:owner>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:user uuid="3f0cd34800034c5e9729e92f2388700d">tempest-TaggedAttachmentsTest-1633838755-project-member</nova:user>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:project uuid="bfc3fafd6d4541c1be05fc81ca6988dc">tempest-TaggedAttachmentsTest-1633838755</nova:project>
Aug 17 03:59:46 user nova-compute[72793]:   </nova:owner>
Aug 17 03:59:46 user nova-compute[72793]:   <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 03:59:46 user nova-compute[72793]:   <nova:ports>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:port uuid="eb423df8-c512-4db6-8306-988514364769">
Aug 17 03:59:46 user nova-compute[72793]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 03:59:46 user nova-compute[72793]:     </nova:port>
Aug 17 03:59:46 user nova-compute[72793]:     <nova:port uuid="4d098c01-4414-49b6-afac-022f3e6b3bdd">
Aug 17 03:59:46 user nova-compute[72793]:       <nova:ip type="fixed" address="10.10.10.48" ipVersion="4"/>
Aug 17 03:59:46 user nova-compute[72793]:     </nova:port>
Aug 17 03:59:46 user nova-compute[72793]:   </nova:ports>
Aug 17 03:59:46 user nova-compute[72793]: </nova:instance>
Aug 17 03:59:46 user nova-compute[72793]:  {{(pid=72793) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-42238aee-6110-4b54-928c-ccf589be087a tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "interface-df59fea4-c74f-40c1-bc93-be5085413156-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.452s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkYKFycv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:46 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[899cc0bc-0555-4067-b235-36763ea856a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:59:46 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0504852-0b16-4779-93da-b8507b0e792c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026] added
Aug 17 03:59:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[83814c36-c2ba-4d2c-9524-9decbbb9e839]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9aa22c-3db7-43b7-bb3e-627199451150]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkYKFycv {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkYKFycv" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[56202b27-57bd-48c1-89b3-61b80965d950]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkYKFycv'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da0ef57-2ec1-44c1-85e1-c108a0de1466]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159bc06-8f17-4442-bf10-da9ecab9e301]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c89af-c179-48b4-ada5-48684dfd86a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260]
Aug 17 03:59:47 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'flavor' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee58546b-06e2-44fb-9189-e3876c5d2c8f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d76010c-0fe2-41d4-9911-132e08bff58f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 03:59:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:47 user nova-compute[72793]: INFO nova.compute.manager [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Attaching volume 69b58aba-48b6-4bec-be3a-425c38783033 to /dev/vdb
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b9be71-b071-4dff-ba45-c201b01fef5c]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkYKFycv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:47 user nova-compute[72793]: INFO nova.compute.manager [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Attaching volume 512dac37-7433-4efc-84f0-997b19a7700b to /dev/vdb
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.utils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c80518-aa57-4451-8a79-f0aa0f2d4ea8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c48ff93-6e4b-48df-8e6d-db8a01ca5419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e4263a-663f-4b0a-9b89-af220a4c4443]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e562b-772f-45e6-a598-7a6bad9a4344]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.utils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d3a14-2e4d-43be-8fbe-93cfd3f57221]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:47 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67685e8f-fb8d-407d-8dbf-afda0b95a29f]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.utils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updating existing volume attachment record: 535dd5a1-1f56-4484-b531-a326f0b923a5 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[795c59c8-22d9-49f9-a40c-e47881681812]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b054920-418e-43ef-a6d9-53834c455176]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4343ab-d5ff-4a1e-9ac7-eaa409023771]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 03:59:47 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 03:59:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b48e0-4c1f-4fcf-9743-64f8cc4aaf4a]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG os_brick.utils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:47 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating existing volume attachment record: f51ce154-24f6-4050-a88d-3b87efd4f16e {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-46680db3-ea2a-49b3-b41c-10aac0d3e5aa req-ae5681e6-4b90-43da-9660-ae3b4c47f299 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46680db3-ea2a-49b3-b41c-10aac0d3e5aa req-ae5681e6-4b90-43da-9660-ae3b4c47f299 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46680db3-ea2a-49b3-b41c-10aac0d3e5aa req-ae5681e6-4b90-43da-9660-ae3b4c47f299 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46680db3-ea2a-49b3-b41c-10aac0d3e5aa req-ae5681e6-4b90-43da-9660-ae3b4c47f299 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-46680db3-ea2a-49b3-b41c-10aac0d3e5aa req-ae5681e6-4b90-43da-9660-ae3b4c47f299 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 03:59:48 user nova-compute[72793]: WARNING nova.compute.manager [req-46680db3-ea2a-49b3-b41c-10aac0d3e5aa req-ae5681e6-4b90-43da-9660-ae3b4c47f299 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd for instance with vm_state active and task_state None.
Aug 17 03:59:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23137623437303062', 'path': '/dev/sde'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137623437303062', 'path': '/dev/sde'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lazy-loading 'flavor' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 03:59:48 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 03:59:48 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 03:59:48 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 03:59:48 user nova-compute[72793]:   <serial>8bdb328e-9d52-4bf3-9345-ecf04be33026</serial>
Aug 17 03:59:48 user nova-compute[72793]: </disk>
Aug 17 03:59:48 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 03:59:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] No VIF found with MAC fa:16:3e:f1:4a:dd, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 03:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:52 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244777.4292169, db7dfa83-dd42-427d-9b41-1b308e7448be => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 03:59:52 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] VM Stopped (Lifecycle Event)
Aug 17 03:59:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e78a6b73-9827-4605-af3f-1638d7f07232 None None] [instance: db7dfa83-dd42-427d-9b41-1b308e7448be] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 03:59:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 03:59:59 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:59 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 03:59:59 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[70130906-ca43-4241-9187-2b4c0e5e430d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 03:59:59 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d164905-abbb-4a44-bf1d-3b0abfbb649a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033] added
Aug 17 03:59:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.075s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aef849-cf55-44d0-a5e5-3408e0954fb6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfa3364-3969-4d45-b78b-b6d276e0779b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v toiXrcMH {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v toiXrcMH" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5716de02-c8d3-4289-9e3f-b0fb7c503e18]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'toiXrcMH'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f6829-a1aa-4ae5-9d90-909a2da9811e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06930d88-b29c-4f8f-ad3b-c3d949274d25]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec512b-4304-4716-8a73-de253a0b7dce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]
Aug 17 03:59:59 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.
Aug 17 03:59:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9de201-aa77-4537-864d-aea27671cf6b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad15b838-3ef6-4a93-ad76-55fa0fdf72a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 03:59:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f9050-0d6f-4c60-86fd-e279424851d2]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 03:59:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:00 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:00:00 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.817733764648438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 2f348045-d3ba-409a-b57b-58bbdd86341c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 706f36b4-71ed-4433-8598-e22a8d47d24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance df59fea4-c74f-40c1-bc93-be5085413156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 23e09e58-5a60-45d5-922a-75e11a206a91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23236353736396164', 'path': '/dev/sdg'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236353736396164', 'path': '/dev/sdg'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lazy-loading 'flavor' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:00:00 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:00 user nova-compute[72793]:   <source dev="/dev/sdg"/>
Aug 17 04:00:00 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:00 user nova-compute[72793]:   <serial>69b58aba-48b6-4bec-be3a-425c38783033</serial>
Aug 17 04:00:00 user nova-compute[72793]: </disk>
Aug 17 04:00:00 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:00:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] No VIF found with MAC fa:16:3e:d4:61:ff, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-changed-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Refreshing instance network info cache due to event network-changed-07c47f54-74de-4003-bdcd-73f85b27f1e5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] Acquiring lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] Acquired lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Refreshing network info cache for port 07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updated VIF entry in instance network info cache for port 07c47f54-74de-4003-bdcd-73f85b27f1e5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updating instance_info_cache with network_info: [{"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ba4e9fc3-25ad-4706-a0f1-6498bb23fcf9 req-608d5ccb-45d7-46e2-b241-d1df84c6708e service nova] Releasing lock "refresh_cache-31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:00:02 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:00:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:00:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNHLsBFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:05 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:00:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd1fb0-74c6-4721-993f-0c3b48473c7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:00:06 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1501b3-9729-4c3c-b609-cc99c0bd2812]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a] added
Aug 17 04:00:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5209e9e-dc11-4307-bf09-74010b51081a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7852502-b211-4278-8ade-8c508b2ebbc2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNHLsBFo {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNHLsBFo" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a5a10-0be6-4ece-b842-aa91d7b0b0ca]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZNHLsBFo'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5643a1-e455-45f6-8c0f-100066b8dcdf]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMlQEwdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:06 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba7e34-ebd2-43c6-b2a0-0fcb32e8cf49]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[38199ec0-0f17-4d00-8b6f-e3a696c3058f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260]
Aug 17 04:00:06 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fadb2c36-c4f1-495f-b718-4acc3ba86a88 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.806s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab10a8-b118-4f27-b310-3a257984ed05]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e32b9241-3c3f-4298-b472-200584588e05 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.080s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac688307-334e-48c7-a8bf-07e0de18430d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:06 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4690f7b1-82d6-4fca-8878-ada91914fd7d]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNHLsBFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:00:06 user nova-compute[72793]: INFO nova.compute.manager [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Rebuilding instance
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'trusted_certs' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'pci_requests' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'pci_devices' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'resources' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'migration_context' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26439666232646634', 'path': '/dev/sdh'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439666232646634', 'path': '/dev/sdh'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.216s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:07 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:07 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72793) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eefc3e1-cc98-470d-b031-c8bb30d609c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:00:07 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'flavor' on Instance uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c48b442-08a6-47ee-8c0b-0e0d6b7828dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8] added
Aug 17 04:00:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:00:07 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:07 user nova-compute[72793]:   <source dev="/dev/sdh"/>
Aug 17 04:00:07 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:07 user nova-compute[72793]:   <serial>d3ae77aa-2557-4d6e-b7da-448b89e4fe0a</serial>
Aug 17 04:00:07 user nova-compute[72793]: </disk>
Aug 17 04:00:07 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b584b0-ae39-45c1-b8cd-49c136c91df5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c815fe-c484-44cb-8e1d-2bce591b57e6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMlQEwdy {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cMlQEwdy" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9341d755-5d62-4512-a053-8ddf7dde4db4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cMlQEwdy'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d36763f-05be-4cd5-8f22-3bf6e5f8f341]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d238fa-cf6e-4220-af98-d52cc311348a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28aebe3-002e-4cbf-a661-237b535e3d7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260]
Aug 17 04:00:07 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5640a3ee-38e1-433a-8888-56d1c9840ba5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[011300c6-0182-4012-8458-f6a7d7209f21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:07 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-64933d45-7735-4b16-81d9-8718a20d9d9a req-5c8d8497-f13e-4966-a578-109b8974d368 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-unplugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-64933d45-7735-4b16-81d9-8718a20d9d9a req-5c8d8497-f13e-4966-a578-109b8974d368 service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-64933d45-7735-4b16-81d9-8718a20d9d9a req-5c8d8497-f13e-4966-a578-109b8974d368 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-64933d45-7735-4b16-81d9-8718a20d9d9a req-5c8d8497-f13e-4966-a578-109b8974d368 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-64933d45-7735-4b16-81d9-8718a20d9d9a req-5c8d8497-f13e-4966-a578-109b8974d368 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-unplugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:07 user nova-compute[72793]: WARNING nova.compute.manager [req-64933d45-7735-4b16-81d9-8718a20d9d9a req-5c8d8497-f13e-4966-a578-109b8974d368 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-unplugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state active and task_state rebuilding.
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] volume_snapshot_create: create_info: {'snapshot_id': '999f88c5-f205-43b4-abde-6cb78969d6ac', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72793) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] snap xml: <domainsnapshot>
Aug 17 04:00:07 user nova-compute[72793]:   <disks>
Aug 17 04:00:07 user nova-compute[72793]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 17 04:00:07 user nova-compute[72793]:       <source file="/dev/new_file"/>
Aug 17 04:00:07 user nova-compute[72793]:     </disk>
Aug 17 04:00:07 user nova-compute[72793]:     <disk name="vda" snapshot="no"/>
Aug 17 04:00:07 user nova-compute[72793]:   </disks>
Aug 17 04:00:07 user nova-compute[72793]: </domainsnapshot>
Aug 17 04:00:07 user nova-compute[72793]:  {{(pid=72793) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lazy-loading 'system_metadata' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[311135c0-86ca-467c-8291-095c4e00dcaa]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMlQEwdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8af8157a-0d75-4653-8584-0fc2ce9d6248 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] volume_snapshot_delete: delete_info: {'volume_id': '8bdb328e-9d52-4bf3-9345-ecf04be33026'} {{(pid=72793) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [None req-8af8157a-0d75-4653-8584-0fc2ce9d6248 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Traceback (most recent call last):
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     if delete_info['type'] != 'qcow2':
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] KeyError: 'type'
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] 
Aug 17 04:00:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Traceback (most recent call last):
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     rv = execute(f, *args, **kwargs)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     six.reraise(c, e, tb)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     raise value
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     rv = meth(*args, **kwargs)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] 
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Traceback (most recent call last):
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     self._volume_snapshot_create(context, instance, guest,
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     rv = execute(f, *args, **kwargs)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     six.reraise(c, e, tb)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     raise value
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     rv = meth(*args, **kwargs)
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:07 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] 
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No VIF found with MAC fa:16:3e:96:24:8a, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [None req-8af8157a-0d75-4653-8584-0fc2ce9d6248 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-443b5cc1-bc08-418d-9a6a-6d76b72a4243)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 999f88c5-f205-43b4-abde-6cb78969d6ac could not be found.
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 999f88c5-f205-43b4-abde-6cb78969d6ac could not be found. (HTTP 404) (Request-ID: req-4f24c9f6-91a6-4e4e-a8b6-6a90ac04be17)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 999f88c5-f205-43b4-abde-6cb78969d6ac could not be found.
Aug 17 04:00:08 user nova-compute[72793]: ERROR nova.virt.libvirt.driver 
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.utils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server [None req-8af8157a-0d75-4653-8584-0fc2ce9d6248 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server 
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server [None req-db5c55c7-8326-4a67-91a0-aad032f422b2 tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 04:00:08 user nova-compute[72793]: ERROR oslo_messaging.rpc.server 
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a87c11-c997-4588-a2d3-8893877f4ab5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e333bf3c-1106-40ea-aaaa-9ed2f4969d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f4f203-591a-4230-8347-71da9c03f5ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d5745-ef68-4012-801e-bbc542ec53f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dbb973b6-8835-4017-966b-85898ab857d5 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.291s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:00:08 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9af9ab-50e7-4e1a-a6a1-a061f904fa47]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.utils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance destroyed successfully.
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance destroyed successfully.
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924638203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-917225422',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDlQJCI7rjvlO55Em8P3/L29qbMQcM7TGvwcHeUUvSNLXuhg3UnhsGj5W2Id2HCnfxiEhL7JNP5OzbDmWKx6l92PP088myRaT0v0OING/Z0OZwctCgd6AjAXMkWxDRTog==',key_name='tempest-keypair-2019873661',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='509f87a040314d60ab44619f429bf643',ramdisk_id='',reservation_id='r-itn0ol3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-696729334',owner_user_name='tempest-ServerActionsV293TestJSON-696729334-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc25ca429a24dd69d17c141308f8b33',uuid=31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converting VIF {"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07c47f54-74, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:08 user nova-compute[72793]: INFO os_vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74')
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:08 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.compute.manager [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Swapping volume 69b58aba-48b6-4bec-be3a-425c38783033 for 9b86e980-4389-41ed-bba3-5bd58099651a
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.compute.manager [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Detaching volume 8bdb328e-9d52-4bf3-9345-ecf04be33026
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.virt.block_device [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Attempting to driver detach volume 8bdb328e-9d52-4bf3-9345-ecf04be33026 from mountpoint /dev/vdb
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Attempting to detach device vdb from instance 2f348045-d3ba-409a-b57b-58bbdd86341c from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:08 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:08 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:00:08 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:08 user nova-compute[72793]:   <serial>8bdb328e-9d52-4bf3-9345-ecf04be33026</serial>
Aug 17 04:00:08 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:00:08 user nova-compute[72793]: </disk>
Aug 17 04:00:08 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Successfully detached device vdb from instance 2f348045-d3ba-409a-b57b-58bbdd86341c from the persistent domain config.
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f348045-d3ba-409a-b57b-58bbdd86341c from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:08 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:08 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:00:08 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:08 user nova-compute[72793]:   <serial>8bdb328e-9d52-4bf3-9345-ecf04be33026</serial>
Aug 17 04:00:08 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:00:08 user nova-compute[72793]: </disk>
Aug 17 04:00:08 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] <== connect_volume: return (2720ms) {'type': 'block', 'scsi_wwn': '23962376563326638', 'path': '/dev/sdi'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962376563326638', 'path': '/dev/sdi'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.612s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lazy-loading 'flavor' on Instance uuid 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacc8bc8-8016-499f-92b8-1d209d12b79f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:00:08 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:08 user nova-compute[72793]:   <source dev="/dev/sdi"/>
Aug 17 04:00:08 user nova-compute[72793]:   <target dev="sdc" bus="scsi"/>
Aug 17 04:00:08 user nova-compute[72793]:   <serial>db8f63f0-709f-42ee-b63a-afe848bfbca8</serial>
Aug 17 04:00:08 user nova-compute[72793]:   <address type="drive" controller="0" unit="2"/>
Aug 17 04:00:08 user nova-compute[72793]: </disk>
Aug 17 04:00:08 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e712b-b9f6-48ea-bf17-58941ba6ca21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:08 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98ffcc6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:08 user nova-compute[72793]: INFO nova.compute.manager [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Detaching volume d3ae77aa-2557-4d6e-b7da-448b89e4fe0a
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4624df4-ac28-4cb1-82b3-c77b96f599f0]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5167b08-4f24-4f39-880f-fd2711f7f0f5]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430496f-f9b0-48de-94b9-c69c2dd8acba]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: INFO nova.virt.block_device [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Attempting to driver detach volume d3ae77aa-2557-4d6e-b7da-448b89e4fe0a from mountpoint /dev/vdb
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Attempting to detach device vdb from instance 62329071-aa56-4d72-9053-e84606823cd1 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:09 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:09 user nova-compute[72793]:   <source dev="/dev/sdh"/>
Aug 17 04:00:09 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:09 user nova-compute[72793]:   <serial>d3ae77aa-2557-4d6e-b7da-448b89e4fe0a</serial>
Aug 17 04:00:09 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:00:09 user nova-compute[72793]: </disk>
Aug 17 04:00:09 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Successfully detached device vdb from instance 62329071-aa56-4d72-9053-e84606823cd1 from the persistent domain config.
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62329071-aa56-4d72-9053-e84606823cd1 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:09 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:09 user nova-compute[72793]:   <source dev="/dev/sdh"/>
Aug 17 04:00:09 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:09 user nova-compute[72793]:   <serial>d3ae77aa-2557-4d6e-b7da-448b89e4fe0a</serial>
Aug 17 04:00:09 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:00:09 user nova-compute[72793]: </disk>
Aug 17 04:00:09 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b3c7e0-2446-4fbd-a9eb-0b87ec09d3a6]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692244809.1226377, 2f348045-d3ba-409a-b57b-58bbdd86341c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[008f53f7-e95e-4c05-9a74-5f7229b1a8bb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:00:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Successfully detached device vdb from instance 2f348045-d3ba-409a-b57b-58bbdd86341c from the live domain config.
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkYKFycv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:09 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6cd22a-5537-42a6-bbd2-0e47ef4f769a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]
Aug 17 04:00:09 user nova-compute[72793]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd6d4ab-316c-4449-959f-fb157695fdf9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== disconnect_volume: return (983ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Deleting instance files /opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13_del
Aug 17 04:00:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Deletion of /opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13_del complete
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.112s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[98239d99-c772-45c9-9435-9505b0627e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd1a137-13af-4f5c-8ebf-4b0f8782780d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f00f1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026'): ({'sde'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Removing single pathed devices sde {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9201eb-4f55-4363-a9a1-59f3cb3aaa09]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db90c2-9c79-405a-90ac-bb0d3a2f1f97]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Flushing IO for device /dev/sde {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d41c0cc-4ced-4e9c-bb75-efa38e196b9e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aaab35-a0ad-4b7f-a909-0dff072c4c52]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d62d00-bfda-4f46-86c8-a7b1aea36c1c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 could not be found.
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:09 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0bf992-3642-4d36-89ca-2b76948c1dd4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260]
Aug 17 04:00:09 user nova-compute[72793]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdb328e-9d52-4bf3-9345-ecf04be33026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e39a14-d337-4091-aa1e-bb42e2d4730e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] <== disconnect_volume: return (429ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.051s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No BDM found with device name sda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] No VIF found with MAC fa:16:3e:7e:9f:73, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[80404b0d-1bd4-4607-8310-7a4c2557642d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[371d8633-2693-4106-879d-4d51704e8250]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0265cf0>, {}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Disconnecting from: [] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== disconnect_volume: return (120ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692244809.8078666, 62329071-aa56-4d72-9053-e84606823cd1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:00:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Successfully detached device vdb from instance 62329071-aa56-4d72-9053-e84606823cd1 from the live domain config.
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNHLsBFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:09 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec528f5-81c7-4b4d-b68f-9d32e124095c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-8add426a-94ec-4f34-86f7-a16e6ae73563 req-cd185605-cd49-4a69-aa73-624416196a92 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8add426a-94ec-4f34-86f7-a16e6ae73563 req-cd185605-cd49-4a69-aa73-624416196a92 service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8add426a-94ec-4f34-86f7-a16e6ae73563 req-cd185605-cd49-4a69-aa73-624416196a92 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8add426a-94ec-4f34-86f7-a16e6ae73563 req-cd185605-cd49-4a69-aa73-624416196a92 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-8add426a-94ec-4f34-86f7-a16e6ae73563 req-cd185605-cd49-4a69-aa73-624416196a92 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:09 user nova-compute[72793]: WARNING nova.compute.manager [req-8add426a-94ec-4f34-86f7-a16e6ae73563 req-cd185605-cd49-4a69-aa73-624416196a92 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state active and task_state rebuilding.
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8d3d6-ff1d-484d-8d4d-a3d87aa6429d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:09 user nova-compute[72793]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a (non-flash)
Aug 17 04:00:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0264e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a'): ({'sdh'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Removing single pathed devices sdh {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bd9d2e-efec-425e-8d0e-ab9754382f6b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56b72c-0032-4dd7-8d27-c0022f43224e]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Flushing IO for device /dev/sdh {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[406a9d2f-53eb-4e1a-8994-fc53610e3dbb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f82e28-03f7-4ae0-8d76-4c954da2df10]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] SCSI volumes sdh have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f61604-c3bb-4184-af3e-e27b6bcfa6ff]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7ebffc-42e4-4621-863c-1dedc7684203]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260]
Aug 17 04:00:10 user nova-compute[72793]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:10 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3ae77aa-2557-4d6e-b7da-448b89e4fe0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b8a37d-f58e-4a3d-bd23-dfd222ffe83d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] <== disconnect_volume: return (316ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBqfVaKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:11 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:11 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:11 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf2596d-0d19-480f-8090-7dc17031a438]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:00:11 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d286ff-f40a-4ee5-bc45-d5e6464156db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b] added
Aug 17 04:00:11 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88b35c1f-dd68-4b43-a47f-0f74e2708832 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.212s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[717437fa-0ccf-49c3-bf6e-1d3a9c879bfa]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6dee5b-a632-477b-b9f6-ca659fadf7af]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBqfVaKN {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBqfVaKN" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ae9ef-ee7b-472a-81f5-85de33026b89]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBqfVaKN'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f4ea61-4852-42b7-9e5b-41fb7ea69e55]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a83c01-beb0-4a93-9986-b12f1e188793]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1f2ea-4f59-44dd-83f3-d6dec59e8cbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260]
Aug 17 04:00:11 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:11 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d902c1aa-957b-4567-8d36-3fe0a95ca082]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e8fe73-32fb-4578-9fbd-12a2aee70eae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:11 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd1f29-248f-4f61-8cf9-3c7ee6ec624e]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:11 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Preparing to wait for external event volume-reimaged-d2a859f4-3d7c-40d9-a818-e709fd9cf187 {{(pid=72793) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBqfVaKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23333346339333832', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333346339333832', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG nova.objects.instance [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'flavor' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:00:12 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:12 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:00:12 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:12 user nova-compute[72793]:   <serial>512dac37-7433-4efc-84f0-997b19a7700b</serial>
Aug 17 04:00:12 user nova-compute[72793]: </disk>
Aug 17 04:00:12 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No BDM found with device name hda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] No VIF found with MAC fa:16:3e:fc:8d:cc, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'flavor' on Instance uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b23bd83c-fef2-4a05-8ad7-fe5b2917281e tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.736s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5c31ac2b-5294-423d-b1bf-03ce2e3ecfa9 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.504s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:14 user nova-compute[72793]: INFO nova.compute.manager [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Detaching volume db8f63f0-709f-42ee-b63a-afe848bfbca8
Aug 17 04:00:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:14 user nova-compute[72793]: INFO nova.virt.block_device [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Attempting to driver detach volume db8f63f0-709f-42ee-b63a-afe848bfbca8 from mountpoint /dev/sdc
Aug 17 04:00:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Attempting to detach device sdc from instance 706f36b4-71ed-4433-8598-e22a8d47d24a from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:00:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:14 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:14 user nova-compute[72793]:   <source dev="/dev/sdi"/>
Aug 17 04:00:14 user nova-compute[72793]:   <target dev="sdc" bus="scsi"/>
Aug 17 04:00:14 user nova-compute[72793]:   <serial>db8f63f0-709f-42ee-b63a-afe848bfbca8</serial>
Aug 17 04:00:14 user nova-compute[72793]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 04:00:14 user nova-compute[72793]: </disk>
Aug 17 04:00:14 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:14 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Successfully detached device sdc from instance 706f36b4-71ed-4433-8598-e22a8d47d24a from the persistent domain config.
Aug 17 04:00:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 706f36b4-71ed-4433-8598-e22a8d47d24a from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:00:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:14 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:14 user nova-compute[72793]:   <source dev="/dev/sdi"/>
Aug 17 04:00:14 user nova-compute[72793]:   <target dev="sdc" bus="scsi"/>
Aug 17 04:00:14 user nova-compute[72793]:   <serial>db8f63f0-709f-42ee-b63a-afe848bfbca8</serial>
Aug 17 04:00:14 user nova-compute[72793]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 04:00:14 user nova-compute[72793]: </disk>
Aug 17 04:00:14 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692244815.073891, 706f36b4-71ed-4433-8598-e22a8d47d24a => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:00:15 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Successfully detached device sdc from instance 706f36b4-71ed-4433-8598-e22a8d47d24a from the live domain config.
Aug 17 04:00:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cMlQEwdy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:15 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff0e4c-353e-43bb-bd21-250dc5db817a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[700aced1-5747-4484-bea4-44f4a4e5601c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d079c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8'): ({'sdi'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Removing single pathed devices sdi {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d85f502-0ab9-4250-8812-7b7a650d245c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f767f-a8bf-4b6c-a712-2d14537a68ed]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Flushing IO for device /dev/sdi {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0533939a-1414-404b-acac-2e29bf8d610c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.060s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d6f91-bbdc-4156-b1b8-661f1171b166]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] SCSI volumes sdi have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a45c1-89af-4195-b9b7-c02d5cc0d801]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed42cd39-6ab0-4e5d-8947-5b9a8082eeab]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260]
Aug 17 04:00:15 user nova-compute[72793]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db8f63f0-709f-42ee-b63a-afe848bfbca8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f395ddd-d0e6-46ca-9510-6db7726230d0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] <== disconnect_volume: return (334ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lazy-loading 'flavor' on Instance uuid 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c5883000-3258-4805-b2b9-4ba400a158a2 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.847s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:16 user nova-compute[72793]: INFO nova.compute.manager [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Detaching volume 512dac37-7433-4efc-84f0-997b19a7700b
Aug 17 04:00:16 user nova-compute[72793]: INFO nova.virt.block_device [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Attempting to driver detach volume 512dac37-7433-4efc-84f0-997b19a7700b from mountpoint /dev/vdb
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Attempting to detach device vdb from instance df59fea4-c74f-40c1-bc93-be5085413156 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:17 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:17 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:00:17 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:17 user nova-compute[72793]:   <serial>512dac37-7433-4efc-84f0-997b19a7700b</serial>
Aug 17 04:00:17 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 04:00:17 user nova-compute[72793]: </disk>
Aug 17 04:00:17 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:17 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully detached device vdb from instance df59fea4-c74f-40c1-bc93-be5085413156 from the persistent domain config.
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df59fea4-c74f-40c1-bc93-be5085413156 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:17 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:17 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:00:17 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:17 user nova-compute[72793]:   <serial>512dac37-7433-4efc-84f0-997b19a7700b</serial>
Aug 17 04:00:17 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 04:00:17 user nova-compute[72793]: </disk>
Aug 17 04:00:17 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:17 user nova-compute[72793]: INFO nova.compute.manager [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Terminating instance
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692244817.5309815, df59fea4-c74f-40c1-bc93-be5085413156 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:00:17 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully detached device vdb from instance df59fea4-c74f-40c1-bc93-be5085413156 from the live domain config.
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBqfVaKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:17 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb614c-fbcb-4e56-9ee6-2c9c9db7149a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3aafb-e9a4-4d41-b1d4-6e594f2d591f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:17 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f02f3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-75894b08-8dd6-4d82-b68e-7f84be18d1af req-2a945543-e241-4893-aa97-6e76e5e8a95c service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-vif-unplugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75894b08-8dd6-4d82-b68e-7f84be18d1af req-2a945543-e241-4893-aa97-6e76e5e8a95c service nova] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75894b08-8dd6-4d82-b68e-7f84be18d1af req-2a945543-e241-4893-aa97-6e76e5e8a95c service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75894b08-8dd6-4d82-b68e-7f84be18d1af req-2a945543-e241-4893-aa97-6e76e5e8a95c service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-75894b08-8dd6-4d82-b68e-7f84be18d1af req-2a945543-e241-4893-aa97-6e76e5e8a95c service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] No waiting events found dispatching network-vif-unplugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-75894b08-8dd6-4d82-b68e-7f84be18d1af req-2a945543-e241-4893-aa97-6e76e5e8a95c service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-vif-unplugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca3da56-cfce-4b84-9a92-722d946fcd69]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4f05bb-e52f-411f-a178-6f09b3b0185c]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[291424d5-995a-4b6c-8ab5-3631f66155ae]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[161c160b-30b5-46c9-90f8-6b206f9e6045]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6d7ca5-c17f-4fd0-a4b5-a0704a57cf54]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4f975-2795-4be6-96e0-b5ec428c7afd]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260]
Aug 17 04:00:17 user nova-compute[72793]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512dac37-7433-4efc-84f0-997b19a7700b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fbbafd-bbf5-44fb-af58-10f6ccbe3694]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] <== disconnect_volume: return (349ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Instance destroyed successfully.
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lazy-loading 'resources' on Instance uuid 706f36b4-71ed-4433-8598-e22a8d47d24a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-860631933',display_name='tempest-AttachSCSIVolumeTestJSON-server-860631933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-860631933',id=6,image_ref='eec7ef4f-707a-477b-a841-68eaa56af11c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLb8Is51FuyujMUUqL5JqENY0CtrBjOwc00MxPpRSsL6r3teVclqWvhDjBDOrt4XWslG+ua2PWL1Yo29TLR1xIeq+Tfv35Q+icS4Kl+ESR3h6YH6wDCWVQVAHW2X+YYnQ==',key_name='tempest-keypair-1914423591',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb76bc5bdb542d182aceecdfdabb0e4',ramdisk_id='',reservation_id='r-0b0ep0k7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='eec7ef4f-707a-477b-a841-68eaa56af11c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1340770866',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1340770866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd00021a75fc400081f34179e388e58d',uuid=706f36b4-71ed-4433-8598-e22a8d47d24a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Converting VIF {"id": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "address": "fa:16:3e:7e:9f:73", "network": {"id": "32c45ad5-aed1-475c-bdc4-47fb433e29a3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-227750025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb76bc5bdb542d182aceecdfdabb0e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e64c7aa-cb", "ovs_interfaceid": "6e64c7aa-cb61-4d85-92cf-f7bb30cfc176", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG os_vif [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e64c7aa-cb, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:18 user nova-compute[72793]: INFO os_vif [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176,network=Network(32c45ad5-aed1-475c-bdc4-47fb433e29a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e64c7aa-cb')
Aug 17 04:00:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Deleting instance files /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a_del
Aug 17 04:00:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Deletion of /opt/stack/data/nova/instances/706f36b4-71ed-4433-8598-e22a8d47d24a_del complete
Aug 17 04:00:18 user nova-compute[72793]: INFO nova.compute.manager [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 04:00:18 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'flavor' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ff8f87b6-69f5-46e0-93d1-73b57934353c tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.967s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "interface-df59fea4-c74f-40c1-bc93-be5085413156-4d098c01-4414-49b6-afac-022f3e6b3bdd" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "interface-df59fea4-c74f-40c1-bc93-be5085413156-4d098c01-4414-49b6-afac-022f3e6b3bdd" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'flavor' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7f:3e:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4d098c01-44"/></interface> {{(pid=72793) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7f:3e:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4d098c01-44"/></interface> {{(pid=72793) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Attempting to detach device tap4d098c01-44 from instance df59fea4-c74f-40c1-bc93-be5085413156 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] detach device xml: <interface type="ethernet">
Aug 17 04:00:18 user nova-compute[72793]:   <mac address="fa:16:3e:7f:3e:11"/>
Aug 17 04:00:18 user nova-compute[72793]:   <model type="virtio"/>
Aug 17 04:00:18 user nova-compute[72793]:   <mtu size="1442"/>
Aug 17 04:00:18 user nova-compute[72793]:   <target dev="tap4d098c01-44"/>
Aug 17 04:00:18 user nova-compute[72793]: </interface>
Aug 17 04:00:18 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7f:3e:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4d098c01-44"/></interface> {{(pid=72793) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7f:3e:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4d098c01-44"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 17 04:00:18 user nova-compute[72793]:   <name>instance-00000009</name>
Aug 17 04:00:18 user nova-compute[72793]:   <uuid>df59fea4-c74f-40c1-bc93-be5085413156</uuid>
Aug 17 04:00:18 user nova-compute[72793]:   <metadata>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:00:18 user nova-compute[72793]:   <nova:package version="0.0.0"/>
Aug 17 04:00:18 user nova-compute[72793]:   <nova:name>tempest-device-tagging-server-1405185482</nova:name>
Aug 17 04:00:18 user nova-compute[72793]:   <nova:creationTime>2023-08-17 03:59:46</nova:creationTime>
Aug 17 04:00:18 user nova-compute[72793]:   <nova:flavor name="m1.tiny">
Aug 17 04:00:18 user nova-compute[72793]:     <nova:memory>512</nova:memory>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:disk>1</nova:disk>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:swap>0</nova:swap>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:vcpus>1</nova:vcpus>
Aug 17 04:00:18 user nova-compute[72793]:   </nova:flavor>
Aug 17 04:00:18 user nova-compute[72793]:   <nova:owner>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:user uuid="3f0cd34800034c5e9729e92f2388700d">tempest-TaggedAttachmentsTest-1633838755-project-member</nova:user>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:project uuid="bfc3fafd6d4541c1be05fc81ca6988dc">tempest-TaggedAttachmentsTest-1633838755</nova:project>
Aug 17 04:00:18 user nova-compute[72793]:   </nova:owner>
Aug 17 04:00:18 user nova-compute[72793]:   <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:00:18 user nova-compute[72793]:   <nova:ports>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:port uuid="eb423df8-c512-4db6-8306-988514364769">
Aug 17 04:00:18 user nova-compute[72793]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:00:18 user nova-compute[72793]:     </nova:port>
Aug 17 04:00:18 user nova-compute[72793]:     <nova:port uuid="4d098c01-4414-49b6-afac-022f3e6b3bdd">
Aug 17 04:00:18 user nova-compute[72793]:       <nova:ip type="fixed" address="10.10.10.48" ipVersion="4"/>
Aug 17 04:00:18 user nova-compute[72793]:     </nova:port>
Aug 17 04:00:18 user nova-compute[72793]:   </nova:ports>
Aug 17 04:00:18 user nova-compute[72793]: </nova:instance>
Aug 17 04:00:18 user nova-compute[72793]:   </metadata>
Aug 17 04:00:18 user nova-compute[72793]:   <memory unit='KiB'>524288</memory>
Aug 17 04:00:18 user nova-compute[72793]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 04:00:18 user nova-compute[72793]:   <vcpu placement='static'>1</vcpu>
Aug 17 04:00:18 user nova-compute[72793]:   <resource>
Aug 17 04:00:18 user nova-compute[72793]:     <partition>/machine</partition>
Aug 17 04:00:18 user nova-compute[72793]:   </resource>
Aug 17 04:00:18 user nova-compute[72793]:   <sysinfo type='smbios'>
Aug 17 04:00:18 user nova-compute[72793]:     <system>
Aug 17 04:00:18 user nova-compute[72793]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 04:00:18 user nova-compute[72793]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 04:00:18 user nova-compute[72793]:       <entry name='version'>0.0.0</entry>
Aug 17 04:00:18 user nova-compute[72793]:       <entry name='serial'>df59fea4-c74f-40c1-bc93-be5085413156</entry>
Aug 17 04:00:18 user nova-compute[72793]:       <entry name='uuid'>df59fea4-c74f-40c1-bc93-be5085413156</entry>
Aug 17 04:00:18 user nova-compute[72793]:       <entry name='family'>Virtual Machine</entry>
Aug 17 04:00:18 user nova-compute[72793]:     </system>
Aug 17 04:00:18 user nova-compute[72793]:   </sysinfo>
Aug 17 04:00:18 user nova-compute[72793]:   <os>
Aug 17 04:00:18 user nova-compute[72793]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 04:00:18 user nova-compute[72793]:     <boot dev='hd'/>
Aug 17 04:00:18 user nova-compute[72793]:     <smbios mode='sysinfo'/>
Aug 17 04:00:18 user nova-compute[72793]:   </os>
Aug 17 04:00:18 user nova-compute[72793]:   <features>
Aug 17 04:00:18 user nova-compute[72793]:     <acpi/>
Aug 17 04:00:18 user nova-compute[72793]:     <apic/>
Aug 17 04:00:18 user nova-compute[72793]:     <vmcoreinfo state='on'/>
Aug 17 04:00:18 user nova-compute[72793]:   </features>
Aug 17 04:00:18 user nova-compute[72793]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 04:00:18 user nova-compute[72793]:     <model fallback='forbid'>Nehalem</model>
Aug 17 04:00:18 user nova-compute[72793]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 04:00:18 user nova-compute[72793]:     <feature policy='require' name='vme'/>
Aug 17 04:00:18 user nova-compute[72793]:     <feature policy='require' name='x2apic'/>
Aug 17 04:00:18 user nova-compute[72793]:     <feature policy='require' name='hypervisor'/>
Aug 17 04:00:18 user nova-compute[72793]:   </cpu>
Aug 17 04:00:18 user nova-compute[72793]:   <clock offset='utc'>
Aug 17 04:00:18 user nova-compute[72793]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 04:00:18 user nova-compute[72793]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 04:00:18 user nova-compute[72793]:     <timer name='hpet' present='no'/>
Aug 17 04:00:18 user nova-compute[72793]:   </clock>
Aug 17 04:00:18 user nova-compute[72793]:   <on_poweroff>destroy</on_poweroff>
Aug 17 04:00:18 user nova-compute[72793]:   <on_reboot>restart</on_reboot>
Aug 17 04:00:18 user nova-compute[72793]:   <on_crash>destroy</on_crash>
Aug 17 04:00:18 user nova-compute[72793]:   <devices>
Aug 17 04:00:18 user nova-compute[72793]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 04:00:18 user nova-compute[72793]:     <disk type='file' device='disk'>
Aug 17 04:00:18 user nova-compute[72793]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 04:00:18 user nova-compute[72793]:       <source file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk' index='2'/>
Aug 17 04:00:18 user nova-compute[72793]:       <backingStore type='file' index='3'>
Aug 17 04:00:18 user nova-compute[72793]:         <format type='raw'/>
Aug 17 04:00:18 user nova-compute[72793]:         <source file='/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d'/>
Aug 17 04:00:18 user nova-compute[72793]:         <backingStore/>
Aug 17 04:00:18 user nova-compute[72793]:       </backingStore>
Aug 17 04:00:18 user nova-compute[72793]:       <target dev='vda' bus='virtio'/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='virtio-disk0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </disk>
Aug 17 04:00:18 user nova-compute[72793]:     <disk type='file' device='cdrom'>
Aug 17 04:00:18 user nova-compute[72793]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 04:00:18 user nova-compute[72793]:       <source file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.config' index='1'/>
Aug 17 04:00:18 user nova-compute[72793]:       <backingStore/>
Aug 17 04:00:18 user nova-compute[72793]:       <target dev='hda' bus='ide'/>
Aug 17 04:00:18 user nova-compute[72793]:       <readonly/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='ide0-0-0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </disk>
Aug 17 04:00:18 user nova-compute[72793]:     <controller type='usb' index='0' model='none'>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='usb'/>
Aug 17 04:00:18 user nova-compute[72793]:     </controller>
Aug 17 04:00:18 user nova-compute[72793]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='pci.0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </controller>
Aug 17 04:00:18 user nova-compute[72793]:     <controller type='ide' index='0'>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='ide'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 04:00:18 user nova-compute[72793]:     </controller>
Aug 17 04:00:18 user nova-compute[72793]:     <interface type='ethernet'>
Aug 17 04:00:18 user nova-compute[72793]:       <mac address='fa:16:3e:fc:8d:cc'/>
Aug 17 04:00:18 user nova-compute[72793]:       <target dev='tapeb423df8-c5'/>
Aug 17 04:00:18 user nova-compute[72793]:       <model type='virtio'/>
Aug 17 04:00:18 user nova-compute[72793]:       <mtu size='1442'/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='net0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </interface>
Aug 17 04:00:18 user nova-compute[72793]:     <interface type='ethernet'>
Aug 17 04:00:18 user nova-compute[72793]:       <mac address='fa:16:3e:7f:3e:11'/>
Aug 17 04:00:18 user nova-compute[72793]:       <target dev='tap4d098c01-44'/>
Aug 17 04:00:18 user nova-compute[72793]:       <model type='virtio'/>
Aug 17 04:00:18 user nova-compute[72793]:       <mtu size='1442'/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='net1'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </interface>
Aug 17 04:00:18 user nova-compute[72793]:     <serial type='pty'>
Aug 17 04:00:18 user nova-compute[72793]:       <source path='/dev/pts/8'/>
Aug 17 04:00:18 user nova-compute[72793]:       <log file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/console.log' append='off'/>
Aug 17 04:00:18 user nova-compute[72793]:       <target type='isa-serial' port='0'>
Aug 17 04:00:18 user nova-compute[72793]:         <model name='isa-serial'/>
Aug 17 04:00:18 user nova-compute[72793]:       </target>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='serial0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </serial>
Aug 17 04:00:18 user nova-compute[72793]:     <console type='pty' tty='/dev/pts/8'>
Aug 17 04:00:18 user nova-compute[72793]:       <source path='/dev/pts/8'/>
Aug 17 04:00:18 user nova-compute[72793]:       <log file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/console.log' append='off'/>
Aug 17 04:00:18 user nova-compute[72793]:       <target type='serial' port='0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='serial0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </console>
Aug 17 04:00:18 user nova-compute[72793]:     <input type='mouse' bus='ps2'>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='input0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </input>
Aug 17 04:00:18 user nova-compute[72793]:     <input type='keyboard' bus='ps2'>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='input1'/>
Aug 17 04:00:18 user nova-compute[72793]:     </input>
Aug 17 04:00:18 user nova-compute[72793]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 17 04:00:18 user nova-compute[72793]:       <listen type='address' address='0.0.0.0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </graphics>
Aug 17 04:00:18 user nova-compute[72793]:     <audio id='1' type='none'/>
Aug 17 04:00:18 user nova-compute[72793]:     <video>
Aug 17 04:00:18 user nova-compute[72793]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='video0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </video>
Aug 17 04:00:18 user nova-compute[72793]:     <memballoon model='virtio'>
Aug 17 04:00:18 user nova-compute[72793]:       <stats period='10'/>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='balloon0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </memballoon>
Aug 17 04:00:18 user nova-compute[72793]:     <rng model='virtio'>
Aug 17 04:00:18 user nova-compute[72793]:       <backend model='random'>/dev/urandom</backend>
Aug 17 04:00:18 user nova-compute[72793]:       <alias name='rng0'/>
Aug 17 04:00:18 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 04:00:18 user nova-compute[72793]:     </rng>
Aug 17 04:00:18 user nova-compute[72793]:   </devices>
Aug 17 04:00:18 user nova-compute[72793]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 04:00:18 user nova-compute[72793]:     <label>libvirt-df59fea4-c74f-40c1-bc93-be5085413156</label>
Aug 17 04:00:18 user nova-compute[72793]:     <imagelabel>libvirt-df59fea4-c74f-40c1-bc93-be5085413156</imagelabel>
Aug 17 04:00:18 user nova-compute[72793]:   </seclabel>
Aug 17 04:00:18 user nova-compute[72793]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 04:00:18 user nova-compute[72793]:     <label>+64055:+108</label>
Aug 17 04:00:18 user nova-compute[72793]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 04:00:18 user nova-compute[72793]:   </seclabel>
Aug 17 04:00:18 user nova-compute[72793]: </domain>
Aug 17 04:00:18 user nova-compute[72793]:  {{(pid=72793) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 04:00:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully detached device tap4d098c01-44 from instance df59fea4-c74f-40c1-bc93-be5085413156 from the persistent domain config.
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] (1/8): Attempting to detach device tap4d098c01-44 with device alias net1 from instance df59fea4-c74f-40c1-bc93-be5085413156 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:00:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] detach device xml: <interface type="ethernet">
Aug 17 04:00:18 user nova-compute[72793]:   <mac address="fa:16:3e:7f:3e:11"/>
Aug 17 04:00:18 user nova-compute[72793]:   <model type="virtio"/>
Aug 17 04:00:18 user nova-compute[72793]:   <mtu size="1442"/>
Aug 17 04:00:18 user nova-compute[72793]:   <target dev="tap4d098c01-44"/>
Aug 17 04:00:18 user nova-compute[72793]: </interface>
Aug 17 04:00:18 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692244819.298691, df59fea4-c74f-40c1-bc93-be5085413156 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Start waiting for the detach event from libvirt for device tap4d098c01-44 with device alias net1 for instance df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7f:3e:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4d098c01-44"/></interface> {{(pid=72793) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7f:3e:11"/><model type="virtio"/><mtu size="1442"/><target dev="tap4d098c01-44"/></interface>not found in domain: <domain type='kvm' id='9'>
Aug 17 04:00:19 user nova-compute[72793]:   <name>instance-00000009</name>
Aug 17 04:00:19 user nova-compute[72793]:   <uuid>df59fea4-c74f-40c1-bc93-be5085413156</uuid>
Aug 17 04:00:19 user nova-compute[72793]:   <metadata>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:00:19 user nova-compute[72793]:   <nova:package version="0.0.0"/>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:name>tempest-device-tagging-server-1405185482</nova:name>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:creationTime>2023-08-17 03:59:46</nova:creationTime>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:flavor name="m1.tiny">
Aug 17 04:00:19 user nova-compute[72793]:     <nova:memory>512</nova:memory>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:disk>1</nova:disk>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:swap>0</nova:swap>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:vcpus>1</nova:vcpus>
Aug 17 04:00:19 user nova-compute[72793]:   </nova:flavor>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:owner>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:user uuid="3f0cd34800034c5e9729e92f2388700d">tempest-TaggedAttachmentsTest-1633838755-project-member</nova:user>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:project uuid="bfc3fafd6d4541c1be05fc81ca6988dc">tempest-TaggedAttachmentsTest-1633838755</nova:project>
Aug 17 04:00:19 user nova-compute[72793]:   </nova:owner>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:ports>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:port uuid="eb423df8-c512-4db6-8306-988514364769">
Aug 17 04:00:19 user nova-compute[72793]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:00:19 user nova-compute[72793]:     </nova:port>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:port uuid="4d098c01-4414-49b6-afac-022f3e6b3bdd">
Aug 17 04:00:19 user nova-compute[72793]:       <nova:ip type="fixed" address="10.10.10.48" ipVersion="4"/>
Aug 17 04:00:19 user nova-compute[72793]:     </nova:port>
Aug 17 04:00:19 user nova-compute[72793]:   </nova:ports>
Aug 17 04:00:19 user nova-compute[72793]: </nova:instance>
Aug 17 04:00:19 user nova-compute[72793]:   </metadata>
Aug 17 04:00:19 user nova-compute[72793]:   <memory unit='KiB'>524288</memory>
Aug 17 04:00:19 user nova-compute[72793]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 04:00:19 user nova-compute[72793]:   <vcpu placement='static'>1</vcpu>
Aug 17 04:00:19 user nova-compute[72793]:   <resource>
Aug 17 04:00:19 user nova-compute[72793]:     <partition>/machine</partition>
Aug 17 04:00:19 user nova-compute[72793]:   </resource>
Aug 17 04:00:19 user nova-compute[72793]:   <sysinfo type='smbios'>
Aug 17 04:00:19 user nova-compute[72793]:     <system>
Aug 17 04:00:19 user nova-compute[72793]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 04:00:19 user nova-compute[72793]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 04:00:19 user nova-compute[72793]:       <entry name='version'>0.0.0</entry>
Aug 17 04:00:19 user nova-compute[72793]:       <entry name='serial'>df59fea4-c74f-40c1-bc93-be5085413156</entry>
Aug 17 04:00:19 user nova-compute[72793]:       <entry name='uuid'>df59fea4-c74f-40c1-bc93-be5085413156</entry>
Aug 17 04:00:19 user nova-compute[72793]:       <entry name='family'>Virtual Machine</entry>
Aug 17 04:00:19 user nova-compute[72793]:     </system>
Aug 17 04:00:19 user nova-compute[72793]:   </sysinfo>
Aug 17 04:00:19 user nova-compute[72793]:   <os>
Aug 17 04:00:19 user nova-compute[72793]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 04:00:19 user nova-compute[72793]:     <boot dev='hd'/>
Aug 17 04:00:19 user nova-compute[72793]:     <smbios mode='sysinfo'/>
Aug 17 04:00:19 user nova-compute[72793]:   </os>
Aug 17 04:00:19 user nova-compute[72793]:   <features>
Aug 17 04:00:19 user nova-compute[72793]:     <acpi/>
Aug 17 04:00:19 user nova-compute[72793]:     <apic/>
Aug 17 04:00:19 user nova-compute[72793]:     <vmcoreinfo state='on'/>
Aug 17 04:00:19 user nova-compute[72793]:   </features>
Aug 17 04:00:19 user nova-compute[72793]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 04:00:19 user nova-compute[72793]:     <model fallback='forbid'>Nehalem</model>
Aug 17 04:00:19 user nova-compute[72793]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 04:00:19 user nova-compute[72793]:     <feature policy='require' name='vme'/>
Aug 17 04:00:19 user nova-compute[72793]:     <feature policy='require' name='x2apic'/>
Aug 17 04:00:19 user nova-compute[72793]:     <feature policy='require' name='hypervisor'/>
Aug 17 04:00:19 user nova-compute[72793]:   </cpu>
Aug 17 04:00:19 user nova-compute[72793]:   <clock offset='utc'>
Aug 17 04:00:19 user nova-compute[72793]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 04:00:19 user nova-compute[72793]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 04:00:19 user nova-compute[72793]:     <timer name='hpet' present='no'/>
Aug 17 04:00:19 user nova-compute[72793]:   </clock>
Aug 17 04:00:19 user nova-compute[72793]:   <on_poweroff>destroy</on_poweroff>
Aug 17 04:00:19 user nova-compute[72793]:   <on_reboot>restart</on_reboot>
Aug 17 04:00:19 user nova-compute[72793]:   <on_crash>destroy</on_crash>
Aug 17 04:00:19 user nova-compute[72793]:   <devices>
Aug 17 04:00:19 user nova-compute[72793]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 04:00:19 user nova-compute[72793]:     <disk type='file' device='disk'>
Aug 17 04:00:19 user nova-compute[72793]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 04:00:19 user nova-compute[72793]:       <source file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk' index='2'/>
Aug 17 04:00:19 user nova-compute[72793]:       <backingStore type='file' index='3'>
Aug 17 04:00:19 user nova-compute[72793]:         <format type='raw'/>
Aug 17 04:00:19 user nova-compute[72793]:         <source file='/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d'/>
Aug 17 04:00:19 user nova-compute[72793]:         <backingStore/>
Aug 17 04:00:19 user nova-compute[72793]:       </backingStore>
Aug 17 04:00:19 user nova-compute[72793]:       <target dev='vda' bus='virtio'/>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='virtio-disk0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </disk>
Aug 17 04:00:19 user nova-compute[72793]:     <disk type='file' device='cdrom'>
Aug 17 04:00:19 user nova-compute[72793]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 04:00:19 user nova-compute[72793]:       <source file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk.config' index='1'/>
Aug 17 04:00:19 user nova-compute[72793]:       <backingStore/>
Aug 17 04:00:19 user nova-compute[72793]:       <target dev='hda' bus='ide'/>
Aug 17 04:00:19 user nova-compute[72793]:       <readonly/>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='ide0-0-0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </disk>
Aug 17 04:00:19 user nova-compute[72793]:     <controller type='usb' index='0' model='none'>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='usb'/>
Aug 17 04:00:19 user nova-compute[72793]:     </controller>
Aug 17 04:00:19 user nova-compute[72793]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='pci.0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </controller>
Aug 17 04:00:19 user nova-compute[72793]:     <controller type='ide' index='0'>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='ide'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 04:00:19 user nova-compute[72793]:     </controller>
Aug 17 04:00:19 user nova-compute[72793]:     <interface type='ethernet'>
Aug 17 04:00:19 user nova-compute[72793]:       <mac address='fa:16:3e:fc:8d:cc'/>
Aug 17 04:00:19 user nova-compute[72793]:       <target dev='tapeb423df8-c5'/>
Aug 17 04:00:19 user nova-compute[72793]:       <model type='virtio'/>
Aug 17 04:00:19 user nova-compute[72793]:       <mtu size='1442'/>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='net0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </interface>
Aug 17 04:00:19 user nova-compute[72793]:     <serial type='pty'>
Aug 17 04:00:19 user nova-compute[72793]:       <source path='/dev/pts/8'/>
Aug 17 04:00:19 user nova-compute[72793]:       <log file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/console.log' append='off'/>
Aug 17 04:00:19 user nova-compute[72793]:       <target type='isa-serial' port='0'>
Aug 17 04:00:19 user nova-compute[72793]:         <model name='isa-serial'/>
Aug 17 04:00:19 user nova-compute[72793]:       </target>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='serial0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </serial>
Aug 17 04:00:19 user nova-compute[72793]:     <console type='pty' tty='/dev/pts/8'>
Aug 17 04:00:19 user nova-compute[72793]:       <source path='/dev/pts/8'/>
Aug 17 04:00:19 user nova-compute[72793]:       <log file='/opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/console.log' append='off'/>
Aug 17 04:00:19 user nova-compute[72793]:       <target type='serial' port='0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='serial0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </console>
Aug 17 04:00:19 user nova-compute[72793]:     <input type='mouse' bus='ps2'>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='input0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </input>
Aug 17 04:00:19 user nova-compute[72793]:     <input type='keyboard' bus='ps2'>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='input1'/>
Aug 17 04:00:19 user nova-compute[72793]:     </input>
Aug 17 04:00:19 user nova-compute[72793]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Aug 17 04:00:19 user nova-compute[72793]:       <listen type='address' address='0.0.0.0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </graphics>
Aug 17 04:00:19 user nova-compute[72793]:     <audio id='1' type='none'/>
Aug 17 04:00:19 user nova-compute[72793]:     <video>
Aug 17 04:00:19 user nova-compute[72793]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='video0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </video>
Aug 17 04:00:19 user nova-compute[72793]:     <memballoon model='virtio'>
Aug 17 04:00:19 user nova-compute[72793]:       <stats period='10'/>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='balloon0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </memballoon>
Aug 17 04:00:19 user nova-compute[72793]:     <rng model='virtio'>
Aug 17 04:00:19 user nova-compute[72793]:       <backend model='random'>/dev/urandom</backend>
Aug 17 04:00:19 user nova-compute[72793]:       <alias name='rng0'/>
Aug 17 04:00:19 user nova-compute[72793]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 04:00:19 user nova-compute[72793]:     </rng>
Aug 17 04:00:19 user nova-compute[72793]:   </devices>
Aug 17 04:00:19 user nova-compute[72793]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 04:00:19 user nova-compute[72793]:     <label>libvirt-df59fea4-c74f-40c1-bc93-be5085413156</label>
Aug 17 04:00:19 user nova-compute[72793]:     <imagelabel>libvirt-df59fea4-c74f-40c1-bc93-be5085413156</imagelabel>
Aug 17 04:00:19 user nova-compute[72793]:   </seclabel>
Aug 17 04:00:19 user nova-compute[72793]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 04:00:19 user nova-compute[72793]:     <label>+64055:+108</label>
Aug 17 04:00:19 user nova-compute[72793]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 04:00:19 user nova-compute[72793]:   </seclabel>
Aug 17 04:00:19 user nova-compute[72793]: </domain>
Aug 17 04:00:19 user nova-compute[72793]:  {{(pid=72793) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 04:00:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully detached device tap4d098c01-44 from instance df59fea4-c74f-40c1-bc93-be5085413156 from the live domain config.
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "address": "fa:16:3e:7f:3e:11", "network": {"id": "47dbfcec-42fe-4149-9d79-777ed4ac02cb", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-392655831", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d098c01-44", "ovs_interfaceid": "4d098c01-4414-49b6-afac-022f3e6b3bdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG os_vif [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d098c01-44, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: INFO os_vif [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:3e:11,bridge_name='br-int',has_traffic_filtering=True,id=4d098c01-4414-49b6-afac-022f3e6b3bdd,network=Network(47dbfcec-42fe-4149-9d79-777ed4ac02cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d098c01-44')
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:00:19 user nova-compute[72793]:   <nova:package version="0.0.0"/>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:name>tempest-device-tagging-server-1405185482</nova:name>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:creationTime>2023-08-17 04:00:19</nova:creationTime>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:flavor name="m1.tiny">
Aug 17 04:00:19 user nova-compute[72793]:     <nova:memory>512</nova:memory>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:disk>1</nova:disk>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:swap>0</nova:swap>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:vcpus>1</nova:vcpus>
Aug 17 04:00:19 user nova-compute[72793]:   </nova:flavor>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:owner>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:user uuid="3f0cd34800034c5e9729e92f2388700d">tempest-TaggedAttachmentsTest-1633838755-project-member</nova:user>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:project uuid="bfc3fafd6d4541c1be05fc81ca6988dc">tempest-TaggedAttachmentsTest-1633838755</nova:project>
Aug 17 04:00:19 user nova-compute[72793]:   </nova:owner>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:00:19 user nova-compute[72793]:   <nova:ports>
Aug 17 04:00:19 user nova-compute[72793]:     <nova:port uuid="eb423df8-c512-4db6-8306-988514364769">
Aug 17 04:00:19 user nova-compute[72793]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:00:19 user nova-compute[72793]:     </nova:port>
Aug 17 04:00:19 user nova-compute[72793]:   </nova:ports>
Aug 17 04:00:19 user nova-compute[72793]: </nova:instance>
Aug 17 04:00:19 user nova-compute[72793]:  {{(pid=72793) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-8f6a0c8e-ee6c-44eb-a441-cd6f1793f1c0 req-54700aa1-3c80-4a11-bd12-6901236487b9 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-unplugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8f6a0c8e-ee6c-44eb-a441-cd6f1793f1c0 req-54700aa1-3c80-4a11-bd12-6901236487b9 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8f6a0c8e-ee6c-44eb-a441-cd6f1793f1c0 req-54700aa1-3c80-4a11-bd12-6901236487b9 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8f6a0c8e-ee6c-44eb-a441-cd6f1793f1c0 req-54700aa1-3c80-4a11-bd12-6901236487b9 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-8f6a0c8e-ee6c-44eb-a441-cd6f1793f1c0 req-54700aa1-3c80-4a11-bd12-6901236487b9 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-unplugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:19 user nova-compute[72793]: WARNING nova.compute.manager [req-8f6a0c8e-ee6c-44eb-a441-cd6f1793f1c0 req-54700aa1-3c80-4a11-bd12-6901236487b9 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-unplugged-4d098c01-4414-49b6-afac-022f3e6b3bdd for instance with vm_state active and task_state None.
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-52401040-b7bb-4976-ba89-2a6ccbd3370b req-a2a3c35f-72ff-4e7c-a979-ca26e2d363bd service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-52401040-b7bb-4976-ba89-2a6ccbd3370b req-a2a3c35f-72ff-4e7c-a979-ca26e2d363bd service nova] Acquiring lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-52401040-b7bb-4976-ba89-2a6ccbd3370b req-a2a3c35f-72ff-4e7c-a979-ca26e2d363bd service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-52401040-b7bb-4976-ba89-2a6ccbd3370b req-a2a3c35f-72ff-4e7c-a979-ca26e2d363bd service nova] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-52401040-b7bb-4976-ba89-2a6ccbd3370b req-a2a3c35f-72ff-4e7c-a979-ca26e2d363bd service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] No waiting events found dispatching network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:19 user nova-compute[72793]: WARNING nova.compute.manager [req-52401040-b7bb-4976-ba89-2a6ccbd3370b req-a2a3c35f-72ff-4e7c-a979-ca26e2d363bd service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received unexpected event network-vif-plugged-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 for instance with vm_state active and task_state deleting.
Aug 17 04:00:19 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Took 1.57 seconds to deallocate network for instance.
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-d3146465-d2c2-4a9a-986a-fd68e482864b req-ca0c2389-ba6d-44dc-9150-83e1d95d9cfa service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Received event network-vif-deleted-6e64c7aa-cb61-4d85-92cf-f7bb30cfc176 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:19 user nova-compute[72793]: INFO nova.compute.manager [req-d3146465-d2c2-4a9a-986a-fd68e482864b req-ca0c2389-ba6d-44dc-9150-83e1d95d9cfa service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Neutron deleted interface 6e64c7aa-cb61-4d85-92cf-f7bb30cfc176; detaching it from the instance and deleting it from the info cache
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.network.neutron [req-d3146465-d2c2-4a9a-986a-fd68e482864b req-ca0c2389-ba6d-44dc-9150-83e1d95d9cfa service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-d3146465-d2c2-4a9a-986a-fd68e482864b req-ca0c2389-ba6d-44dc-9150-83e1d95d9cfa service nova] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Detach interface failed, port_id=6e64c7aa-cb61-4d85-92cf-f7bb30cfc176, reason: Instance 706f36b4-71ed-4433-8598-e22a8d47d24a could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:00:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:00:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:20 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Deleted allocations for instance 706f36b4-71ed-4433-8598-e22a8d47d24a
Aug 17 04:00:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f319a9d2-e407-45b6-8ce9-9180e0c9d258 tempest-AttachSCSIVolumeTestJSON-1340770866 tempest-AttachSCSIVolumeTestJSON-1340770866-project-member] Lock "706f36b4-71ed-4433-8598-e22a8d47d24a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.151s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:00:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquired lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:00:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:00:21 user nova-compute[72793]: INFO nova.network.neutron [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Port 4d098c01-4414-49b6-afac-022f3e6b3bdd from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 17 04:00:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [{"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Releasing lock "refresh_cache-df59fea4-c74f-40c1-bc93-be5085413156" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f2433d59-c747-4bdb-a172-22a5c725d961 tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "interface-df59fea4-c74f-40c1-bc93-be5085413156-4d098c01-4414-49b6-afac-022f3e6b3bdd" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.436s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-34d5e4e5-aaa7-4797-82d2-e03cde476bc7 req-0ddbf4f3-3157-4f53-8b56-296d8eb10655 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-34d5e4e5-aaa7-4797-82d2-e03cde476bc7 req-0ddbf4f3-3157-4f53-8b56-296d8eb10655 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-34d5e4e5-aaa7-4797-82d2-e03cde476bc7 req-0ddbf4f3-3157-4f53-8b56-296d8eb10655 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-34d5e4e5-aaa7-4797-82d2-e03cde476bc7 req-0ddbf4f3-3157-4f53-8b56-296d8eb10655 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-34d5e4e5-aaa7-4797-82d2-e03cde476bc7 req-0ddbf4f3-3157-4f53-8b56-296d8eb10655 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:21 user nova-compute[72793]: WARNING nova.compute.manager [req-34d5e4e5-aaa7-4797-82d2-e03cde476bc7 req-0ddbf4f3-3157-4f53-8b56-296d8eb10655 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-4d098c01-4414-49b6-afac-022f3e6b3bdd for instance with vm_state active and task_state None.
Aug 17 04:00:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-a2830297-64cd-441d-84cc-82411681cfba req-c803e7c8-0b7b-409b-87fd-dd01fff96f30 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-deleted-4d098c01-4414-49b6-afac-022f3e6b3bdd {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:22 user nova-compute[72793]: DEBUG nova.objects.instance [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lazy-loading 'flavor' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-57f1ddae-6339-48e7-a297-254703c5911b tempest-VolumesAssistedSnapshotsTest-1951359709 tempest-VolumesAssistedSnapshotsTest-1951359709-project-admin] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 13.686s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:23 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244808.2225978, 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:00:23 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] VM Stopped (Lifecycle Event)
Aug 17 04:00:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a52eb57a-41e5-4a92-a2b4-d71f38c4c6b5 None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAZXQfmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ef016ce-07e3-4fe1-8b99-29cce6862f55', 'attached_at': '', 'detached_at': '', 'volume_id': '9b86e980-4389-41ed-bba3-5bd58099651a', 'serial': '9b86e980-4389-41ed-bba3-5bd58099651a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '8ef016ce-07e3-4fe1-8b99-29cce6862f55', 'attached_at': '', 'detached_at': '', 'volume_id': '69b58aba-48b6-4bec-be3a-425c38783033', 'serial'} {{(pid=72793) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAZXQfmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:24 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527da9a-b9f2-4956-98c8-a8a5459c439d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:00:24 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001a68b-4aa6-4d08-8c71-07e20cf3e86a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a] added
Aug 17 04:00:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6341b-c3cb-474a-a6b9-d6b05ace18c1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad686fe-c3f4-421b-89fb-0d8c44097977]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAZXQfmN {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAZXQfmN" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[428687d8-77ba-4932-ad38-0529184bc693]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAZXQfmN'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d59a162-37ca-4964-8941-4be3ec639f7b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfcb86b-4d8b-4468-83f7-c47e34768a02]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e52a8-6574-423a-9c37-8c7f8bcf8fbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260]
Aug 17 04:00:24 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cde44a1-fd94-4a80-b4c1-803d63325b4d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb69947-0ea8-45ac-b50d-ea9b160fc72f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:00:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[01497be3-4933-4ad2-b464-214720566848]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAZXQfmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26166636661616465', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166636661616465', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lazy-loading 'flavor' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 133169152 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 432013312 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 601882624 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:00:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 735051776 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:00:29 user nova-compute[72793]: INFO nova.compute.claims [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Claim successful on node user
Aug 17 04:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 848297984 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:00:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:00:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 1017118720 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.policy [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b417e88ac27f494997b2d548630a4799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163e4f83cf6c496daaefcf07f2458334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:00:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Creating image(s)
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "/opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "/opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "/opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.236s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk 1073741824" returned: 0 in 0.058s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:30 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0922bd09-55d6-487c-b44e-da89f9ae779b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1804837b-93ab-49f7-b8a0-437200d5342b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02bf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'): ({'sdg'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Removing single pathed devices sdg {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc4e1d-acb3-47db-bc84-c3ead27b7bb3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Successfully created port: dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fb84c-7669-42dd-acb9-eb863ee9561e]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Flushing IO for device /dev/sdg {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.256s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb0740-193b-4970-b34b-375c0dda5ea8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c149138-3474-4ba5-be8d-71016c82b60b]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] SCSI volumes sdg have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc648061-b067-4c97-8f22-ba92f5df5456]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Cannot resize image /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lazy-loading 'migration_context' on Instance uuid 28306d00-a9c4-4395-b2db-e4b59e035f6a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251ea04-a260-4032-a33e-d25c98f2a81d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]
Aug 17 04:00:31 user nova-compute[72793]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f362d6a5-06c3-47a6-8b6f-b9605fd3efe7]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] <== disconnect_volume: return (462ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Ensure instance console log exists: /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAZXQfmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8ef016ce-07e3-4fe1-8b99-29cce6862f55', 'attached_at': '', 'detached_at': '', 'volume_id': '9b86e980-4389-41ed-bba3-5bd58099651a', 'serial'} {{(pid=72793) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] swap_volume: removing Cinder connection for volume 69b58aba-48b6-4bec-be3a-425c38783033 {{(pid=72793) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Successfully updated port: dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "refresh_cache-28306d00-a9c4-4395-b2db-e4b59e035f6a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquired lock "refresh_cache-28306d00-a9c4-4395-b2db-e4b59e035f6a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-changed-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Refreshing instance network info cache due to event network-changed-dbb2255d-474a-4c91-b153-077161406df7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] Acquiring lock "refresh_cache-28306d00-a9c4-4395-b2db-e4b59e035f6a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:00:31 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Updating instance_info_cache with network_info: [{"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Releasing lock "refresh_cache-28306d00-a9c4-4395-b2db-e4b59e035f6a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Instance network_info: |[{"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] Acquired lock "refresh_cache-28306d00-a9c4-4395-b2db-e4b59e035f6a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Refreshing network info cache for port dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Start _get_guest_xml network_info=[{"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:00:32 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:00:32 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-60902547',display_name='tempest-VolumesActionsTest-instance-60902547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-60902547',id=12,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='163e4f83cf6c496daaefcf07f2458334',ramdisk_id='',reservation_id='r-ie7uf60k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053759356',owner_user_name='tempest-VolumesActionsTest-2053759356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:30Z,user_data=None,user_id='b417e88ac27f494997b2d548630a4799',uuid=28306d00-a9c4-4395-b2db-e4b59e035f6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converting VIF {"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lazy-loading 'pci_devices' on Instance uuid 28306d00-a9c4-4395-b2db-e4b59e035f6a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:00:32 user nova-compute[72793]:   <uuid>28306d00-a9c4-4395-b2db-e4b59e035f6a</uuid>
Aug 17 04:00:32 user nova-compute[72793]:   <name>instance-0000000c</name>
Aug 17 04:00:32 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:00:32 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:00:32 user nova-compute[72793]:   <metadata>
Aug 17 04:00:32 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:00:32 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:00:32 user nova-compute[72793]:       <nova:name>tempest-VolumesActionsTest-instance-60902547</nova:name>
Aug 17 04:00:32 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:00:32</nova:creationTime>
Aug 17 04:00:32 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:00:32 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:00:32 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:00:32 user nova-compute[72793]:       <nova:owner>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:user uuid="b417e88ac27f494997b2d548630a4799">tempest-VolumesActionsTest-2053759356-project-member</nova:user>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:project uuid="163e4f83cf6c496daaefcf07f2458334">tempest-VolumesActionsTest-2053759356</nova:project>
Aug 17 04:00:32 user nova-compute[72793]:       </nova:owner>
Aug 17 04:00:32 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:00:32 user nova-compute[72793]:       <nova:ports>
Aug 17 04:00:32 user nova-compute[72793]:         <nova:port uuid="dbb2255d-474a-4c91-b153-077161406df7">
Aug 17 04:00:32 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 04:00:32 user nova-compute[72793]:         </nova:port>
Aug 17 04:00:32 user nova-compute[72793]:       </nova:ports>
Aug 17 04:00:32 user nova-compute[72793]:     </nova:instance>
Aug 17 04:00:32 user nova-compute[72793]:   </metadata>
Aug 17 04:00:32 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:00:32 user nova-compute[72793]:     <system>
Aug 17 04:00:32 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:00:32 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:00:32 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:00:32 user nova-compute[72793]:       <entry name="serial">28306d00-a9c4-4395-b2db-e4b59e035f6a</entry>
Aug 17 04:00:32 user nova-compute[72793]:       <entry name="uuid">28306d00-a9c4-4395-b2db-e4b59e035f6a</entry>
Aug 17 04:00:32 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:00:32 user nova-compute[72793]:     </system>
Aug 17 04:00:32 user nova-compute[72793]:   </sysinfo>
Aug 17 04:00:32 user nova-compute[72793]:   <os>
Aug 17 04:00:32 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:00:32 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:00:32 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:00:32 user nova-compute[72793]:   </os>
Aug 17 04:00:32 user nova-compute[72793]:   <features>
Aug 17 04:00:32 user nova-compute[72793]:     <acpi/>
Aug 17 04:00:32 user nova-compute[72793]:     <apic/>
Aug 17 04:00:32 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:00:32 user nova-compute[72793]:   </features>
Aug 17 04:00:32 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:00:32 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:00:32 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:00:32 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:00:32 user nova-compute[72793]:   </clock>
Aug 17 04:00:32 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:00:32 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:00:32 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:00:32 user nova-compute[72793]:   </cpu>
Aug 17 04:00:32 user nova-compute[72793]:   <devices>
Aug 17 04:00:32 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:00:32 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:00:32 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk"/>
Aug 17 04:00:32 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:00:32 user nova-compute[72793]:     </disk>
Aug 17 04:00:32 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:00:32 user nova-compute[72793]:       <mac address="fa:16:3e:2e:96:ef"/>
Aug 17 04:00:32 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:00:32 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:00:32 user nova-compute[72793]:       <target dev="tapdbb2255d-47"/>
Aug 17 04:00:32 user nova-compute[72793]:     </interface>
Aug 17 04:00:32 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:00:32 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/console.log" append="off"/>
Aug 17 04:00:32 user nova-compute[72793]:     </serial>
Aug 17 04:00:32 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:00:32 user nova-compute[72793]:     <video>
Aug 17 04:00:32 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:00:32 user nova-compute[72793]:     </video>
Aug 17 04:00:32 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:00:32 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:00:32 user nova-compute[72793]:     </rng>
Aug 17 04:00:32 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:00:32 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:00:32 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:00:32 user nova-compute[72793]:     </memballoon>
Aug 17 04:00:32 user nova-compute[72793]:   </devices>
Aug 17 04:00:32 user nova-compute[72793]: </domain>
Aug 17 04:00:32 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-60902547',display_name='tempest-VolumesActionsTest-instance-60902547',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-60902547',id=12,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='163e4f83cf6c496daaefcf07f2458334',ramdisk_id='',reservation_id='r-ie7uf60k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2053759356',owner_user_name='tempest-VolumesActionsTest-2053759356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:30Z,user_data=None,user_id='b417e88ac27f494997b2d548630a4799',uuid=28306d00-a9c4-4395-b2db-e4b59e035f6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converting VIF {"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG os_vif [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb2255d-47, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbb2255d-47, col_values=(('external_ids', {'iface-id': 'dbb2255d-474a-4c91-b153-077161406df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:96:ef', 'vm-uuid': '28306d00-a9c4-4395-b2db-e4b59e035f6a'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:32 user nova-compute[72793]: INFO os_vif [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47')
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] No VIF found with MAC fa:16:3e:2e:96:ef, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Updated VIF entry in instance network info cache for port dbb2255d-474a-4c91-b153-077161406df7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Updating instance_info_cache with network_info: [{"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0355e70f-15ef-4826-b209-aee3d697f58e req-d76a085f-062e-4092-abbd-97a8a4e7a893 service nova] Releasing lock "refresh_cache-28306d00-a9c4-4395-b2db-e4b59e035f6a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244818.062632, 706f36b4-71ed-4433-8598-e22a8d47d24a => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:00:33 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] VM Stopped (Lifecycle Event)
Aug 17 04:00:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-76bc0892-2ed8-4f47-bd02-7b5c2cfd0143 None None] [instance: 706f36b4-71ed-4433-8598-e22a8d47d24a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] swap_volume: Updating volume 69b58aba-48b6-4bec-be3a-425c38783033 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "xAZXQfmN", "auth_password": "b96wFz0cueo3dI", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "9b86e980-4389-41ed-bba3-5bd58099651a"}, "status": "reserved", "instance": "8ef016ce-07e3-4fe1-8b99-29cce6862f55", "attached_at": "", "detached_at": "", "volume_id": "9b86e980-4389-41ed-bba3-5bd58099651a", "serial": "9b86e980-4389-41ed-bba3-5bd58099651a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9b86e980-4389-41ed-bba3-5bd58099651a', 'no_device': None, 'attachment_id': 'bb1341c9-0e3d-40fc-a442-b326ee9b607a'} {{(pid=72793) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ee0b4573-4cc0-4a3a-ad55-d8abe9792261 tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 25.189s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-90718b45-7983-4a76-83b4-b4dacdcde372 req-deb96d5f-d9d4-453b-99d8-bcfd96ee48fc service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-90718b45-7983-4a76-83b4-b4dacdcde372 req-deb96d5f-d9d4-453b-99d8-bcfd96ee48fc service nova] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-90718b45-7983-4a76-83b4-b4dacdcde372 req-deb96d5f-d9d4-453b-99d8-bcfd96ee48fc service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-90718b45-7983-4a76-83b4-b4dacdcde372 req-deb96d5f-d9d4-453b-99d8-bcfd96ee48fc service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-90718b45-7983-4a76-83b4-b4dacdcde372 req-deb96d5f-d9d4-453b-99d8-bcfd96ee48fc service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] No waiting events found dispatching network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:34 user nova-compute[72793]: WARNING nova.compute.manager [req-90718b45-7983-4a76-83b4-b4dacdcde372 req-deb96d5f-d9d4-453b-99d8-bcfd96ee48fc service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received unexpected event network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 for instance with vm_state building and task_state spawning.
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf765041-78b4-4997-b87d-6fa07322e5cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf16187-17bd-4cad-8947-cafdc921b49b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5015d8e4-f5a9-4e27-8f09-20f99e920c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[51849987-e486-4fc6-b538-5e8b8638dccd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:00:34 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:00:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dbb7ea-bca8-491c-812e-dda134ba9da2]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:00:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:34 user nova-compute[72793]: INFO nova.compute.manager [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Swapping volume 9b86e980-4389-41ed-bba3-5bd58099651a for 69b58aba-48b6-4bec-be3a-425c38783033
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244836.1492748, 28306d00-a9c4-4395-b2db-e4b59e035f6a => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] VM Resumed (Lifecycle Event)
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Instance spawned successfully.
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244836.1513486, 28306d00-a9c4-4395-b2db-e4b59e035f6a => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] VM Started (Lifecycle Event)
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-c4a6cbed-c260-4f95-82eb-b2755b734a93 req-84231ebc-8170-4764-bbee-42624ee63b0a service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c4a6cbed-c260-4f95-82eb-b2755b734a93 req-84231ebc-8170-4764-bbee-42624ee63b0a service nova] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c4a6cbed-c260-4f95-82eb-b2755b734a93 req-84231ebc-8170-4764-bbee-42624ee63b0a service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c4a6cbed-c260-4f95-82eb-b2755b734a93 req-84231ebc-8170-4764-bbee-42624ee63b0a service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-c4a6cbed-c260-4f95-82eb-b2755b734a93 req-84231ebc-8170-4764-bbee-42624ee63b0a service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] No waiting events found dispatching network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:36 user nova-compute[72793]: WARNING nova.compute.manager [req-c4a6cbed-c260-4f95-82eb-b2755b734a93 req-84231ebc-8170-4764-bbee-42624ee63b0a service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received unexpected event network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 for instance with vm_state building and task_state spawning.
Aug 17 04:00:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Took 7.52 seconds to build instance.
Aug 17 04:00:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7f291c81-cf40-4a9a-9051-195f50f1b78b tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.641s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b req-25d83f15-4334-462f-a14b-e7fefb2b2449 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event volume-reimaged-d2a859f4-3d7c-40d9-a818-e709fd9cf187 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b req-25d83f15-4334-462f-a14b-e7fefb2b2449 service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b req-25d83f15-4334-462f-a14b-e7fefb2b2449 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b req-25d83f15-4334-462f-a14b-e7fefb2b2449 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b req-25d83f15-4334-462f-a14b-e7fefb2b2449 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Processing event volume-reimaged-d2a859f4-3d7c-40d9-a818-e709fd9cf187 {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:00:37 user nova-compute[72793]: INFO nova.virt.block_device [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Booting with volume d2a859f4-3d7c-40d9-a818-e709fd9cf187 at /dev/vda
Aug 17 04:00:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG os_brick.utils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d98482-9938-4a53-9932-c24c30860c2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc82377d-cff3-4c3a-b48d-8b025842d45c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d7d7af-dd17-4a15-9c65-6804c09bee14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80bb82c-8a42-48ee-ac60-1667bc5613eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:00:37 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:00:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[928992cd-2130-4e0d-ae07-1d9190348496]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG os_brick.utils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:37 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updating existing volume attachment record: 4df7b68d-3579-404a-84c5-d601a3862e2a {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-changed-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing instance network info cache due to event network-changed-a5adbf41-9f1b-4946-89d8-69c7518898a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:00:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] Acquiring lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:00:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] Acquired lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:00:40 user nova-compute[72793]: DEBUG nova.network.neutron [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Refreshing network info cache for port a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:00:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updated VIF entry in instance network info cache for port a5adbf41-9f1b-4946-89d8-69c7518898a7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:00:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1296e285-6458-46d5-822b-60e0009de814 req-a50f4fcb-cef4-4f3b-977b-a67d197767b9 service nova] Releasing lock "refresh_cache-23e09e58-5a60-45d5-922a-75e11a206a91" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:00:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "23e09e58-5a60-45d5-922a-75e11a206a91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:43 user nova-compute[72793]: INFO nova.compute.manager [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Terminating instance
Aug 17 04:00:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-6854b045-2c9d-4802-bb7b-c0d0d316f2fa req-a8f54f02-b786-4e8f-8616-f73056562332 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6854b045-2c9d-4802-bb7b-c0d0d316f2fa req-a8f54f02-b786-4e8f-8616-f73056562332 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6854b045-2c9d-4802-bb7b-c0d0d316f2fa req-a8f54f02-b786-4e8f-8616-f73056562332 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6854b045-2c9d-4802-bb7b-c0d0d316f2fa req-a8f54f02-b786-4e8f-8616-f73056562332 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-6854b045-2c9d-4802-bb7b-c0d0d316f2fa req-a8f54f02-b786-4e8f-8616-f73056562332 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-6854b045-2c9d-4802-bb7b-c0d0d316f2fa req-a8f54f02-b786-4e8f-8616-f73056562332 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-1458129f-8c00-43bf-b5fd-1199a5689ade req-63e070fd-7243-4bb5-ae22-63766067fb27 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1458129f-8c00-43bf-b5fd-1199a5689ade req-63e070fd-7243-4bb5-ae22-63766067fb27 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1458129f-8c00-43bf-b5fd-1199a5689ade req-63e070fd-7243-4bb5-ae22-63766067fb27 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1458129f-8c00-43bf-b5fd-1199a5689ade req-63e070fd-7243-4bb5-ae22-63766067fb27 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-1458129f-8c00-43bf-b5fd-1199a5689ade req-63e070fd-7243-4bb5-ae22-63766067fb27 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-1458129f-8c00-43bf-b5fd-1199a5689ade req-63e070fd-7243-4bb5-ae22-63766067fb27 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Instance destroyed successfully.
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lazy-loading 'resources' on Instance uuid 23e09e58-5a60-45d5-922a-75e11a206a91 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5adbf41-9f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:e4:b2,bridge_name='br-int',has_traffic_filtering=True,id=a5adbf41-9f1b-4946-89d8-69c7518898a7,network=Network(38d45863-354f-42a3-9669-67124e88f256),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5adbf41-9f')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad01a491-82, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:e5:da,bridge_name='br-int',has_traffic_filtering=True,id=ad01a491-829b-4a1c-aebf-3d53f045ca24,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad01a491-82')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1669186-95, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:7b:b4,bridge_name='br-int',has_traffic_filtering=True,id=d1669186-951c-4eab-aec1-44b9b5fbbc41,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd1669186-95')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape482381a-52, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:ad,bridge_name='br-int',has_traffic_filtering=True,id=e482381a-523d-457c-bdbd-094ef9848b52,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape482381a-52')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "2915ae74-0db0-417a-9361-8ec675e97ebc", "address": "fa:16:3e:18:f9:1b", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2915ae74-0d", "ovs_interfaceid": "2915ae74-0db0-417a-9361-8ec675e97ebc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2915ae74-0d, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f9:1b,bridge_name='br-int',has_traffic_filtering=True,id=2915ae74-0db0-417a-9361-8ec675e97ebc,network=Network(401dab5a-4d8a-4200-8afb-ceae3e167d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2915ae74-0d')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15c29453-fa, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ab:71,bridge_name='br-int',has_traffic_filtering=True,id=15c29453-faaa-436f-ad7c-adc113f155ca,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15c29453-fa')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1567675813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1567675813',id=11,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ5ENRD33XsMqMv0tjqUxz/WQ0zuvy8qnEvtTRLA+k52KIFPY7wRZHQPZySvJ0X7WRXIYRC9aRxAO3zxQusuno0YVg/h2jN3rHTJKKT6sCALHzfcWp/NN1ElSIRMRb92w==',key_name='tempest-keypair-1861809136',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:59:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1671538ad9d945c9a737c24ca6bb6e7e',ramdisk_id='',reservation_id='r-p0ivf12n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1361443360',owner_user_name='tempest-TaggedBootDevicesTest-1361443360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a13a9af2372e477fb0f90ab7fb5ab009',uuid=23e09e58-5a60-45d5-922a-75e11a206a91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converting VIF {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8e195ad-1f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:45 user nova-compute[72793]: INFO os_vif [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:f6:b6,bridge_name='br-int',has_traffic_filtering=True,id=b8e195ad-1f39-47cf-8a5d-cf1dfbd787be,network=Network(6b237e17-639a-4139-8eb8-c4f554f2869f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e195ad-1f')
Aug 17 04:00:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tPkETnVu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:45 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a52c9a-5112-4c12-95f4-097b7111a4fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d1d237-4c72-40e8-bcc4-9a91794c76b6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02ba950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f221c63-729b-4c85-b88b-5aaf8606a96e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8037f-929d-4d05-8164-7627054ab216]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-a5adbf41-9f1b-4946-89d8-69c7518898a7 for instance with vm_state active and task_state deleting.
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING nova.compute.manager [req-2285afc9-e7bc-4a81-aa58-9f0cbf07d86f req-2f792f28-a7e4-4ca4-8ae1-4e181f38f9cc service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-d1669186-951c-4eab-aec1-44b9b5fbbc41 for instance with vm_state active and task_state deleting.
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7444dd0-184b-466c-b01d-3df01478bd10]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b3907-7600-477d-b918-983c3d3c2d28]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[244fefcb-673a-46dd-9749-4d605d147a8b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-ad01a491-829b-4a1c-aebf-3d53f045ca24 for instance with vm_state active and task_state deleting.
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-e482381a-523d-457c-bdbd-094ef9848b52 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-e482381a-523d-457c-bdbd-094ef9848b52 for instance with vm_state active and task_state deleting.
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-2915ae74-0db0-417a-9361-8ec675e97ebc for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-2915ae74-0db0-417a-9361-8ec675e97ebc for instance with vm_state active and task_state deleting.
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING nova.compute.manager [req-e61e41fa-fe6d-455f-924e-733ca15a9284 req-259dc341-dbdf-4401-b9f0-97151069a904 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be for instance with vm_state active and task_state deleting.
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcd1203-a403-4ef1-9b34-0989efba7d9e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260]
Aug 17 04:00:46 user nova-compute[72793]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa467d95-33e0-4d62-baec-683a6899934c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa771a8-9e3c-488a-b4e3-878145a8f724]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== disconnect_volume: return (355ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scLizQwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77b46d-b4e7-4313-b57a-65773c0856b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3953e756-0788-4175-a973-028740ac4ca0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0267d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18'): ({'sdd'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Removing single pathed devices sdd {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc127b52-6550-4d2c-a864-2cdc281cdaa3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7050702-665f-40d7-adfe-b1f2d72ea537]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Flushing IO for device /dev/sdd {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[63510cb0-e9c4-44a0-b1eb-9798ca6fcac1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0cc1ad-fe21-48f9-975b-7022e17ebd51]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b8f13e-9489-4d73-899f-7c3295175ed9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea727db2-37a1-4573-841a-0d49b6d1e04e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260]
Aug 17 04:00:46 user nova-compute[72793]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e05c9f84-999f-48c7-96c0-0bc1cba71f18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5714400-3c49-4f5b-bb20-a5784aad7576]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== disconnect_volume: return (304ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JRyBCYsz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bb668e-6aba-45e7-a522-82d95e2972c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e4c88-eefe-4227-82d0-de24459a60bd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:46 user nova-compute[72793]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 (non-flash)
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0267d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24'): ({'sdf'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Removing single pathed devices sdf {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a6672c-2a35-4308-95a1-c300d3afb681]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[edafc6bf-9ccd-4cfb-be60-c7239f6a4378]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Flushing IO for device /dev/sdf {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d23fa5-8f1d-4796-a7b2-f6017ecf8b3f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1e3263-a068-44d5-b451-e10bfd5b7a40]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] SCSI volumes sdf have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f3b12-d8b4-4142-9568-314d074ec6cc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec270aa-d46a-4f4a-8c62-5ba08e5a375e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260]
Aug 17 04:00:46 user nova-compute[72793]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bc5e8dd-a3d4-49a3-ad32-7880636d2c24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[308adc28-3803-48bb-9e86-c99d6b1ff906]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] <== disconnect_volume: return (297ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Deleting instance files /opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91_del
Aug 17 04:00:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Deletion of /opt/stack/data/nova/instances/23e09e58-5a60-45d5-922a-75e11a206a91_del complete
Aug 17 04:00:47 user nova-compute[72793]: INFO nova.compute.manager [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Took 3.47 seconds to destroy the instance on the hypervisor.
Aug 17 04:00:47 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:00:47 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:00:47 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-c55d1be6-70c0-42dc-84d2-61c5a0e51c2a req-e2ef87b3-2b33-43e2-8484-8f470385d283 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c55d1be6-70c0-42dc-84d2-61c5a0e51c2a req-e2ef87b3-2b33-43e2-8484-8f470385d283 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c55d1be6-70c0-42dc-84d2-61c5a0e51c2a req-e2ef87b3-2b33-43e2-8484-8f470385d283 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c55d1be6-70c0-42dc-84d2-61c5a0e51c2a req-e2ef87b3-2b33-43e2-8484-8f470385d283 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-c55d1be6-70c0-42dc-84d2-61c5a0e51c2a req-e2ef87b3-2b33-43e2-8484-8f470385d283 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-unplugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-c55d1be6-70c0-42dc-84d2-61c5a0e51c2a req-e2ef87b3-2b33-43e2-8484-8f470385d283 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-unplugged-15c29453-faaa-436f-ad7c-adc113f155ca for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ef016ce-07e3-4fe1-8b99-29cce6862f55', 'attached_at': '', 'detached_at': '', 'volume_id': '69b58aba-48b6-4bec-be3a-425c38783033', 'serial': '69b58aba-48b6-4bec-be3a-425c38783033'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAZXQfmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '9b86e980-4389-41ed-bba3-5bd58099651a'}, 'status': 'reserved', 'instance': '8ef016ce-07e3-4fe1-8b99-29cce6862f55', 'attached_at': '', 'detached_at': '', 'volume_id': '9b86e980-4389-41ed-bba3-5bd58099651a', 'serial'} {{(pid=72793) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:48 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:48 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:48 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d328f461-f2bf-4a3b-91be-bcd5935f0db1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:00:48 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f8e3aa-8875-414e-8424-262fa727a16f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033] added
Aug 17 04:00:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af3656-d9d9-4c69-9e0a-178bddac059f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40462a8-c8de-4009-8255-c5e421bbd4de]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v toiXrcMH {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v toiXrcMH" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[776fce30-e404-4a8c-9b36-7aee46d031df]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'toiXrcMH'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5393ff-d68a-4d48-a6f5-485042a3cbdf]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c788df-23fe-4744-a613-ee5e068c9d02]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb6938a-97c8-4279-b7ac-f431f31dc773]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]
Aug 17 04:00:48 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9788c-240e-4af4-85ff-c594b4a4facc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c3552-b202-4f81-97cb-35226574ca94]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:48 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:48 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:00:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d900f2a-6ba5-42e0-a16e-131345095936]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:00:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23236353736396164', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236353736396164', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lazy-loading 'flavor' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] Acquiring lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] Lock "23e09e58-5a60-45d5-922a-75e11a206a91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] No waiting events found dispatching network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:50 user nova-compute[72793]: WARNING nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received unexpected event network-vif-plugged-15c29453-faaa-436f-ad7c-adc113f155ca for instance with vm_state active and task_state deleting.
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-deleted-2915ae74-0db0-417a-9361-8ec675e97ebc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:50 user nova-compute[72793]: INFO nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Neutron deleted interface 2915ae74-0db0-417a-9361-8ec675e97ebc; detaching it from the instance and deleting it from the info cache
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.network.neutron [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15c29453-faaa-436f-ad7c-adc113f155ca", "address": "fa:16:3e:45:ab:71", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15c29453-fa", "ovs_interfaceid": "15c29453-faaa-436f-ad7c-adc113f155ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Detach interface failed, port_id=2915ae74-0db0-417a-9361-8ec675e97ebc, reason: Instance 23e09e58-5a60-45d5-922a-75e11a206a91 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-deleted-15c29453-faaa-436f-ad7c-adc113f155ca {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:50 user nova-compute[72793]: INFO nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Neutron deleted interface 15c29453-faaa-436f-ad7c-adc113f155ca; detaching it from the instance and deleting it from the info cache
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.network.neutron [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [{"id": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "address": "fa:16:3e:90:e4:b2", "network": {"id": "38d45863-354f-42a3-9669-67124e88f256", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1086761524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5adbf41-9f", "ovs_interfaceid": "a5adbf41-9f1b-4946-89d8-69c7518898a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "address": "fa:16:3e:dd:e5:da", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad01a491-82", "ovs_interfaceid": "ad01a491-829b-4a1c-aebf-3d53f045ca24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "address": "fa:16:3e:bb:7b:b4", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1669186-95", "ovs_interfaceid": "d1669186-951c-4eab-aec1-44b9b5fbbc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e482381a-523d-457c-bdbd-094ef9848b52", "address": "fa:16:3e:49:3b:ad", "network": {"id": "401dab5a-4d8a-4200-8afb-ceae3e167d7d", "bridge": "br-int", "label": "tempest-device-tagging-net1-193811587", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape482381a-52", "ovs_interfaceid": "e482381a-523d-457c-bdbd-094ef9848b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "address": "fa:16:3e:58:f6:b6", "network": {"id": "6b237e17-639a-4139-8eb8-c4f554f2869f", "bridge": "br-int", "label": "tempest-device-tagging-net2-936608419", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1671538ad9d945c9a737c24ca6bb6e7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e195ad-1f", "ovs_interfaceid": "b8e195ad-1f39-47cf-8a5d-cf1dfbd787be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-1ab957d9-832f-451a-a395-baa4b4d74616 req-82bee508-cbf7-4daf-ba26-d3c2af195cf8 service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Detach interface failed, port_id=15c29453-faaa-436f-ad7c-adc113f155ca, reason: Instance 23e09e58-5a60-45d5-922a-75e11a206a91 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 93323264 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:00:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Creating image(s)
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Ensure instance console log exists: /opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Start _get_guest_xml network_info=[{"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2a859f4-3d7c-40d9-a818-e709fd9cf187', 'serial': 'd2a859f4-3d7c-40d9-a818-e709fd9cf187'}, 'guest_format': None, 'attachment_id': '4df7b68d-3579-404a-84c5-d601a3862e2a', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:00:51 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 04:00:51 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'vcpu_model' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:51 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:51 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:51 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e2dc4-0124-4e08-81ec-6d62128191f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:00:51 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e77077-3687-4262-ada1-3b67c1aa750b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187] added
Aug 17 04:00:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1445bf-8643-4b79-ac9c-ecd0f3c424ee]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d2674d-a05c-4346-84f6-b5033dab45ca]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJhGRykp {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJhGRykp" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d97a8e-e497-4013-8f37-ddf6c0c9ad0c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJhGRykp'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b2622-02dc-4c7d-809a-0cc8927729ea]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 204472320 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3e8c89-1636-4333-8479-9fea4349f6b3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:51 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:51 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 370147328 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:52 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Took 5.10 seconds to deallocate network for instance.
Aug 17 04:00:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-135636b3-06ad-4e72-a4e4-fd4bd0483b9b req-70188f29-0b6d-4633-9a70-44d110b5141a service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-deleted-a5adbf41-9f1b-4946-89d8-69c7518898a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-135636b3-06ad-4e72-a4e4-fd4bd0483b9b req-70188f29-0b6d-4633-9a70-44d110b5141a service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-deleted-b8e195ad-1f39-47cf-8a5d-cf1dfbd787be {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-135636b3-06ad-4e72-a4e4-fd4bd0483b9b req-70188f29-0b6d-4633-9a70-44d110b5141a service nova] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Received event network-vif-deleted-e482381a-523d-457c-bdbd-094ef9848b52 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 504365056 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --login" returned: 0 in 1.075s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[04826890-0bcf-4d7b-9db0-d2836b4830c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]
Aug 17 04:00:52 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[12deb093-b37a-49fc-8ab2-c2743c528756]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a75ee-e0b8-481d-8cf0-65c0204b0156]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:52 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:52 user nova-compute[72793]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:52 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:52 user nova-compute[72793]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.397s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cc7312-ea41-4d6d-abe6-7eab0d6f39ac]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 601882624 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 740294656 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.432s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== connect_volume: return (2433ms) {'type': 'block', 'scsi_wwn': '23538396237303031', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538396237303031', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T03:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924638203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-917225422',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDlQJCI7rjvlO55Em8P3/L29qbMQcM7TGvwcHeUUvSNLXuhg3UnhsGj5W2Id2HCnfxiEhL7JNP5OzbDmWKx6l92PP088myRaT0v0OING/Z0OZwctCgd6AjAXMkWxDRTog==',key_name='tempest-keypair-2019873661',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='509f87a040314d60ab44619f429bf643',ramdisk_id='',reservation_id='r-itn0ol3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-696729334',owner_user_name='tempest-ServerActionsV293TestJSON-696729334-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc25ca429a24dd69d17c141308f8b33',uuid=31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converting VIF {"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:00:53 user nova-compute[72793]:   <uuid>31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13</uuid>
Aug 17 04:00:53 user nova-compute[72793]:   <name>instance-0000000a</name>
Aug 17 04:00:53 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:00:53 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:00:53 user nova-compute[72793]:   <metadata>
Aug 17 04:00:53 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:00:53 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:00:53 user nova-compute[72793]:       <nova:name>tempest-ServerActionsV293TestJSON-server-924638203</nova:name>
Aug 17 04:00:53 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:00:51</nova:creationTime>
Aug 17 04:00:53 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:00:53 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:00:53 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:00:53 user nova-compute[72793]:       <nova:owner>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:user uuid="8cc25ca429a24dd69d17c141308f8b33">tempest-ServerActionsV293TestJSON-696729334-project-member</nova:user>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:project uuid="509f87a040314d60ab44619f429bf643">tempest-ServerActionsV293TestJSON-696729334</nova:project>
Aug 17 04:00:53 user nova-compute[72793]:       </nova:owner>
Aug 17 04:00:53 user nova-compute[72793]:       <nova:ports>
Aug 17 04:00:53 user nova-compute[72793]:         <nova:port uuid="07c47f54-74de-4003-bdcd-73f85b27f1e5">
Aug 17 04:00:53 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 04:00:53 user nova-compute[72793]:         </nova:port>
Aug 17 04:00:53 user nova-compute[72793]:       </nova:ports>
Aug 17 04:00:53 user nova-compute[72793]:     </nova:instance>
Aug 17 04:00:53 user nova-compute[72793]:   </metadata>
Aug 17 04:00:53 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:00:53 user nova-compute[72793]:     <system>
Aug 17 04:00:53 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:00:53 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:00:53 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:00:53 user nova-compute[72793]:       <entry name="serial">31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13</entry>
Aug 17 04:00:53 user nova-compute[72793]:       <entry name="uuid">31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13</entry>
Aug 17 04:00:53 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:00:53 user nova-compute[72793]:     </system>
Aug 17 04:00:53 user nova-compute[72793]:   </sysinfo>
Aug 17 04:00:53 user nova-compute[72793]:   <os>
Aug 17 04:00:53 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:00:53 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:00:53 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:00:53 user nova-compute[72793]:   </os>
Aug 17 04:00:53 user nova-compute[72793]:   <features>
Aug 17 04:00:53 user nova-compute[72793]:     <acpi/>
Aug 17 04:00:53 user nova-compute[72793]:     <apic/>
Aug 17 04:00:53 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:00:53 user nova-compute[72793]:   </features>
Aug 17 04:00:53 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:00:53 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:00:53 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:00:53 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:00:53 user nova-compute[72793]:   </clock>
Aug 17 04:00:53 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:00:53 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:00:53 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:00:53 user nova-compute[72793]:   </cpu>
Aug 17 04:00:53 user nova-compute[72793]:   <devices>
Aug 17 04:00:53 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:00:53 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:53 user nova-compute[72793]:       <source dev="/dev/sdd"/>
Aug 17 04:00:53 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:00:53 user nova-compute[72793]:       <serial>d2a859f4-3d7c-40d9-a818-e709fd9cf187</serial>
Aug 17 04:00:53 user nova-compute[72793]:     </disk>
Aug 17 04:00:53 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:00:53 user nova-compute[72793]:       <mac address="fa:16:3e:bc:f0:05"/>
Aug 17 04:00:53 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:00:53 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:00:53 user nova-compute[72793]:       <target dev="tap07c47f54-74"/>
Aug 17 04:00:53 user nova-compute[72793]:     </interface>
Aug 17 04:00:53 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:00:53 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13/console.log" append="off"/>
Aug 17 04:00:53 user nova-compute[72793]:     </serial>
Aug 17 04:00:53 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:00:53 user nova-compute[72793]:     <video>
Aug 17 04:00:53 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:00:53 user nova-compute[72793]:     </video>
Aug 17 04:00:53 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:00:53 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:00:53 user nova-compute[72793]:     </rng>
Aug 17 04:00:53 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:00:53 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:00:53 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:00:53 user nova-compute[72793]:     </memballoon>
Aug 17 04:00:53 user nova-compute[72793]:   </devices>
Aug 17 04:00:53 user nova-compute[72793]: </domain>
Aug 17 04:00:53 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T03:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924638203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-917225422',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDlQJCI7rjvlO55Em8P3/L29qbMQcM7TGvwcHeUUvSNLXuhg3UnhsGj5W2Id2HCnfxiEhL7JNP5OzbDmWKx6l92PP088myRaT0v0OING/Z0OZwctCgd6AjAXMkWxDRTog==',key_name='tempest-keypair-2019873661',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='509f87a040314d60ab44619f429bf643',ramdisk_id='',reservation_id='r-itn0ol3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-696729334',owner_user_name='tempest-ServerActionsV293TestJSON-696729334-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc25ca429a24dd69d17c141308f8b33',uuid=31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converting VIF {"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG os_vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07c47f54-74, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07c47f54-74, col_values=(('external_ids', {'iface-id': '07c47f54-74de-4003-bdcd-73f85b27f1e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:f0:05', 'vm-uuid': '31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:53 user nova-compute[72793]: INFO os_vif [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74')
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:00:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] No VIF found with MAC fa:16:3e:bc:f0:05, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:00:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 881852416 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 1042284544 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAZXQfmN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '9b86e980-4389-41ed-bba3-5bd58099651a'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:55 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4b90b-019b-49d9-870d-37b1205f4f82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc991bb-b1ce-495c-8690-f84493e8ebf0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:55 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:55 user nova-compute[72793]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a (non-flash)
Aug 17 04:00:55 user nova-compute[72793]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:55 user nova-compute[72793]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07b8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[01791c0a-108b-4115-872d-761c2d2d1297]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee58256-e2b0-4783-b5b4-8eed44ec5c77]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9ea71e-c2cd-4dd7-9aaa-dc2bd227ba4d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6a2383-2878-46f4-bcc8-b2cbbf876079]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b14eb-c2ba-450b-8eb0-94155e1af351]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: INFO nova.compute.manager [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Took 3.77 seconds to detach 3 volumes for instance.
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad11cb8-c50f-47fe-b5ad-84cc39405eaf]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260]
Aug 17 04:00:55 user nova-compute[72793]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b86e980-4389-41ed-bba3-5bd58099651a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb3ce4-cbbd-4ae2-80c6-d6efa99691a6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] <== disconnect_volume: return (375ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8ef016ce-07e3-4fe1-8b99-29cce6862f55', 'attached_at': '', 'detached_at': '', 'volume_id': '69b58aba-48b6-4bec-be3a-425c38783033', 'serial'} {{(pid=72793) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] swap_volume: removing Cinder connection for volume 9b86e980-4389-41ed-bba3-5bd58099651a {{(pid=72793) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-6e765cce-a7a0-4678-8479-10b1dc1aee42 req-b331d824-55a1-4091-b332-ac70b221bb3a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6e765cce-a7a0-4678-8479-10b1dc1aee42 req-b331d824-55a1-4091-b332-ac70b221bb3a service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6e765cce-a7a0-4678-8479-10b1dc1aee42 req-b331d824-55a1-4091-b332-ac70b221bb3a service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6e765cce-a7a0-4678-8479-10b1dc1aee42 req-b331d824-55a1-4091-b332-ac70b221bb3a service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-6e765cce-a7a0-4678-8479-10b1dc1aee42 req-b331d824-55a1-4091-b332-ac70b221bb3a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:56 user nova-compute[72793]: WARNING nova.compute.manager [req-6e765cce-a7a0-4678-8479-10b1dc1aee42 req-b331d824-55a1-4091-b332-ac70b221bb3a service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 04:00:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:00:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.563s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:56 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Deleted allocations for instance 23e09e58-5a60-45d5-922a-75e11a206a91
Aug 17 04:00:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f3816375-73e7-4870-bf4f-a1f22f4f86b2 tempest-TaggedBootDevicesTest-1361443360 tempest-TaggedBootDevicesTest-1361443360-project-member] Lock "23e09e58-5a60-45d5-922a-75e11a206a91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.154s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] swap_volume: Updating volume 9b86e980-4389-41ed-bba3-5bd58099651a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "toiXrcMH", "auth_password": "6gjsqozEQO5kRS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "69b58aba-48b6-4bec-be3a-425c38783033"}, "status": "reserved", "instance": "8ef016ce-07e3-4fe1-8b99-29cce6862f55", "attached_at": "", "detached_at": "", "volume_id": "69b58aba-48b6-4bec-be3a-425c38783033", "serial": "69b58aba-48b6-4bec-be3a-425c38783033"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '69b58aba-48b6-4bec-be3a-425c38783033', 'no_device': None, 'attachment_id': '361b5c6b-a2c6-4030-b774-413a22951c5d'} {{(pid=72793) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 04:00:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8a7a24ba-84ff-4494-abda-3156b52346cb tempest-TestVolumeSwap-569314144 tempest-TestVolumeSwap-569314144-project-admin] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.560s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:57 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244857.970841, 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:00:57 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] VM Resumed (Lifecycle Event)
Aug 17 04:00:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:00:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:00:57 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance spawned successfully.
Aug 17 04:00:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244857.971064, 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] VM Started (Lifecycle Event)
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-64051450-ce16-48f9-bedc-5e24abf93348 req-6458f5cc-bc98-4e65-b007-c0c321b7eafc service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-64051450-ce16-48f9-bedc-5e24abf93348 req-6458f5cc-bc98-4e65-b007-c0c321b7eafc service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-64051450-ce16-48f9-bedc-5e24abf93348 req-6458f5cc-bc98-4e65-b007-c0c321b7eafc service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-64051450-ce16-48f9-bedc-5e24abf93348 req-6458f5cc-bc98-4e65-b007-c0c321b7eafc service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-64051450-ce16-48f9-bedc-5e24abf93348 req-6458f5cc-bc98-4e65-b007-c0c321b7eafc service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:00:58 user nova-compute[72793]: WARNING nova.compute.manager [req-64051450-ce16-48f9-bedc-5e24abf93348 req-6458f5cc-bc98-4e65-b007-c0c321b7eafc service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.compute.manager [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Detaching volume 69b58aba-48b6-4bec-be3a-425c38783033
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.objects.instance [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72793) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.virt.block_device [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Attempting to driver detach volume 69b58aba-48b6-4bec-be3a-425c38783033 from mountpoint /dev/vdb
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Attempting to detach device vdb from instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:58 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:58 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:00:58 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:58 user nova-compute[72793]:   <serial>69b58aba-48b6-4bec-be3a-425c38783033</serial>
Aug 17 04:00:58 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:00:58 user nova-compute[72793]: </disk>
Aug 17 04:00:58 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Successfully detached device vdb from instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 from the persistent domain config.
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:00:58 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:00:58 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:00:58 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:00:58 user nova-compute[72793]:   <serial>69b58aba-48b6-4bec-be3a-425c38783033</serial>
Aug 17 04:00:58 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:00:58 user nova-compute[72793]: </disk>
Aug 17 04:00:58 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-37224c8e-8bbf-4f8c-a44b-0448ceb7a62b tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.137s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.compute.claims [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Claim successful on node user
Aug 17 04:00:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692244858.9144566, 8ef016ce-07e3-4fe1-8b99-29cce6862f55 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:00:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Successfully detached device vdb from instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 from the live domain config.
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'toiXrcMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '69b58aba-48b6-4bec-be3a-425c38783033'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:00:58 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:00:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[499e39e1-abf6-4248-b86d-9cecb9cd517d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c302ecaa-26a1-4c4d-8300-4cf1618f2485]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:59 user nova-compute[72793]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 (non-flash)
Aug 17 04:00:59 user nova-compute[72793]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:00:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98ffcc6710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5045e5ec-9811-4985-ad1a-5c8db301de91]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbabeb0-7f9f-434a-9d12-9ce83997f576]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[88153ffc-f6c9-4df5-921f-d737018f9b75]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af137ab-ae84-435e-aa5e-b34a91aef7db]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e88495-224c-428f-8aa0-96dff9efdddb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --logout" returned: 0 in 0.149s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c79e201-de11-4368-9700-cdd1435dc643]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.policy [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd805a44490b4a969fd9121571f17bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909f9614d1c64730bdcaf1b4d86516da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260]
Aug 17 04:00:59 user nova-compute[72793]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033, portal: 172.16.0.220,3260] successful.
Aug 17 04:00:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:00:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Creating image(s)
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b58aba-48b6-4bec-be3a-425c38783033 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f55bc66-33ab-4750-a90a-7b1e37547e9f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] <== disconnect_volume: return (522ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:00:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.790s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.part --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.virt.images [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] e2a60a23-19a3-4dee-8a4c-11628e30ec03 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.part /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244845.5048234, 23e09e58-5a60-45d5-922a-75e11a206a91 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:00 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] VM Stopped (Lifecycle Event)
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5668f3e4-9a26-4fcd-afdc-a7153c45cc53 None None] [instance: 23e09e58-5a60-45d5-922a-75e11a206a91] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.part /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.converted" returned: 0 in 0.323s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Successfully created port: 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lazy-loading 'flavor' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e1f36afa-3d0f-412c-b5cd-7e859fd9f445 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.593s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.442s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'flavor' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json" returned: 0 in 0.223s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda,backing_fmt=raw /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:01 user nova-compute[72793]: INFO nova.compute.manager [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Attaching volume 8b7bb4ef-1973-40d0-994c-b13795372071 to /dev/vdb
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:01:01 user nova-compute[72793]: INFO nova.compute.claims [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Claim successful on node user
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda,backing_fmt=raw /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk 1073741824" returned: 0 in 0.080s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG os_brick.utils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7d4b58-7127-4c5c-95d5-d4592c94ce41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedba7bc-ef50-4065-846c-5e6dee49543b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json" returned: 0 in 0.249s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ba332b-3d22-4166-80a0-c13f1c482e52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80aa281-5472-4f71-81e2-6090e46f5a3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:01:01 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82fdf98-5a28-49b2-9a40-4cddf69d7f1e]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG os_brick.utils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== get_connector_properties: return (253ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating existing volume attachment record: 7eab48bc-2dea-4977-b242-b7e903d0445e {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Cannot resize image /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'migration_context' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Successfully updated port: 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Ensure instance console log exists: /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing instance network info cache due to event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:01:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.policy [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82e025f0dc8745b3bf13231832816033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584b479f01844391a15d9b00afc60453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance network_info: |[{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Start _get_guest_xml network_info=[{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T04:00:54Z,direct_url=<?>,disk_format='qcow2',id=e2a60a23-19a3-4dee-8a4c-11628e30ec03,min_disk=0,min_ram=0,name='tempest-scenario-img--1075044163',owner='909f9614d1c64730bdcaf1b4d86516da',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T04:00:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': 'e2a60a23-19a3-4dee-8a4c-11628e30ec03'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:01:02 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:02 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T04:00:54Z,direct_url=<?>,disk_format='qcow2',id=e2a60a23-19a3-4dee-8a4c-11628e30ec03,min_disk=0,min_ram=0,name='tempest-scenario-img--1075044163',owner='909f9614d1c64730bdcaf1b4d86516da',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T04:00:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812116502',display_name='tempest-TestMinimumBasicScenario-server-812116502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812116502',id=13,image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN79szzICC00Dbk3h4sD5anhGgYMGJBeVvfL93fsOxN0m2IUuCaq+YaMXyw1pWaDeXYjdWRstBu/R49xPZgXW6kroj7sIPAiABNGniM4BcfeES55lSmGI/QwS9FaKK7nRw==',key_name='tempest-TestMinimumBasicScenario-574191377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-6qfcdjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:59Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=245698d6-2693-404a-b365-e17fc5665259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'pci_devices' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:01:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Creating image(s)
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "/opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "/opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "/opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:01:02 user nova-compute[72793]:   <uuid>245698d6-2693-404a-b365-e17fc5665259</uuid>
Aug 17 04:01:02 user nova-compute[72793]:   <name>instance-0000000d</name>
Aug 17 04:01:02 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:01:02 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:01:02 user nova-compute[72793]:   <metadata>
Aug 17 04:01:02 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:01:02 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:01:02 user nova-compute[72793]:       <nova:name>tempest-TestMinimumBasicScenario-server-812116502</nova:name>
Aug 17 04:01:02 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:01:02</nova:creationTime>
Aug 17 04:01:02 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:01:02 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:01:02 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:01:02 user nova-compute[72793]:       <nova:owner>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:user uuid="cd805a44490b4a969fd9121571f17bb1">tempest-TestMinimumBasicScenario-660102196-project-member</nova:user>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:project uuid="909f9614d1c64730bdcaf1b4d86516da">tempest-TestMinimumBasicScenario-660102196</nova:project>
Aug 17 04:01:02 user nova-compute[72793]:       </nova:owner>
Aug 17 04:01:02 user nova-compute[72793]:       <nova:root type="image" uuid="e2a60a23-19a3-4dee-8a4c-11628e30ec03"/>
Aug 17 04:01:02 user nova-compute[72793]:       <nova:ports>
Aug 17 04:01:02 user nova-compute[72793]:         <nova:port uuid="0e78924b-74b3-4441-917d-1bd448b0a420">
Aug 17 04:01:02 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:01:02 user nova-compute[72793]:         </nova:port>
Aug 17 04:01:02 user nova-compute[72793]:       </nova:ports>
Aug 17 04:01:02 user nova-compute[72793]:     </nova:instance>
Aug 17 04:01:02 user nova-compute[72793]:   </metadata>
Aug 17 04:01:02 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:01:02 user nova-compute[72793]:     <system>
Aug 17 04:01:02 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:01:02 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:01:02 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:01:02 user nova-compute[72793]:       <entry name="serial">245698d6-2693-404a-b365-e17fc5665259</entry>
Aug 17 04:01:02 user nova-compute[72793]:       <entry name="uuid">245698d6-2693-404a-b365-e17fc5665259</entry>
Aug 17 04:01:02 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:01:02 user nova-compute[72793]:     </system>
Aug 17 04:01:02 user nova-compute[72793]:   </sysinfo>
Aug 17 04:01:02 user nova-compute[72793]:   <os>
Aug 17 04:01:02 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:01:02 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:01:02 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:01:02 user nova-compute[72793]:   </os>
Aug 17 04:01:02 user nova-compute[72793]:   <features>
Aug 17 04:01:02 user nova-compute[72793]:     <acpi/>
Aug 17 04:01:02 user nova-compute[72793]:     <apic/>
Aug 17 04:01:02 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:01:02 user nova-compute[72793]:   </features>
Aug 17 04:01:02 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:01:02 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:01:02 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:01:02 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:01:02 user nova-compute[72793]:   </clock>
Aug 17 04:01:02 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:01:02 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:01:02 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:01:02 user nova-compute[72793]:   </cpu>
Aug 17 04:01:02 user nova-compute[72793]:   <devices>
Aug 17 04:01:02 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:01:02 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:01:02 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk"/>
Aug 17 04:01:02 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:01:02 user nova-compute[72793]:     </disk>
Aug 17 04:01:02 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:01:02 user nova-compute[72793]:       <mac address="fa:16:3e:1e:f6:ad"/>
Aug 17 04:01:02 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:02 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:01:02 user nova-compute[72793]:       <target dev="tap0e78924b-74"/>
Aug 17 04:01:02 user nova-compute[72793]:     </interface>
Aug 17 04:01:02 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:01:02 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/console.log" append="off"/>
Aug 17 04:01:02 user nova-compute[72793]:     </serial>
Aug 17 04:01:02 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:01:02 user nova-compute[72793]:     <video>
Aug 17 04:01:02 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:02 user nova-compute[72793]:     </video>
Aug 17 04:01:02 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:01:02 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:01:02 user nova-compute[72793]:     </rng>
Aug 17 04:01:02 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:01:02 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:01:02 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:01:02 user nova-compute[72793]:     </memballoon>
Aug 17 04:01:02 user nova-compute[72793]:   </devices>
Aug 17 04:01:02 user nova-compute[72793]: </domain>
Aug 17 04:01:02 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812116502',display_name='tempest-TestMinimumBasicScenario-server-812116502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812116502',id=13,image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN79szzICC00Dbk3h4sD5anhGgYMGJBeVvfL93fsOxN0m2IUuCaq+YaMXyw1pWaDeXYjdWRstBu/R49xPZgXW6kroj7sIPAiABNGniM4BcfeES55lSmGI/QwS9FaKK7nRw==',key_name='tempest-TestMinimumBasicScenario-574191377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-6qfcdjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:00:59Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=245698d6-2693-404a-b365-e17fc5665259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG os_vif [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e78924b-74, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e78924b-74, col_values=(('external_ids', {'iface-id': '0e78924b-74b3-4441-917d-1bd448b0a420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:f6:ad', 'vm-uuid': '245698d6-2693-404a-b365-e17fc5665259'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:02 user nova-compute[72793]: INFO os_vif [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74')
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.225s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No VIF found with MAC fa:16:3e:1e:f6:ad, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.256s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk 1073741824" returned: 0 in 0.105s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updated VIF entry in instance network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Successfully created port: 7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c7f49517-96aa-4e52-b543-92dc2dc48e68 req-f8c2c521-895f-46d7-8ae8-b6ca7daf9e62 service nova] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.791s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=25.76781463623047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Cannot resize image /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'migration_context' on Instance uuid 84cf389f-3a35-4e65-a7c9-7eb679c48df1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Successfully updated port: 7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 2f348045-d3ba-409a-b57b-58bbdd86341c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance df59fea4-c74f-40c1-bc93-be5085413156 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28306d00-a9c4-4395-b2db-e4b59e035f6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 245698d6-2693-404a-b365-e17fc5665259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 84cf389f-3a35-4e65-a7c9-7eb679c48df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "refresh_cache-84cf389f-3a35-4e65-a7c9-7eb679c48df1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquired lock "refresh_cache-84cf389f-3a35-4e65-a7c9-7eb679c48df1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Ensure instance console log exists: /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-changed-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Refreshing instance network info cache due to event network-changed-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] Acquiring lock "refresh_cache-84cf389f-3a35-4e65-a7c9-7eb679c48df1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Updating instance_info_cache with network_info: [{"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Releasing lock "refresh_cache-84cf389f-3a35-4e65-a7c9-7eb679c48df1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Instance network_info: |[{"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] Acquired lock "refresh_cache-84cf389f-3a35-4e65-a7c9-7eb679c48df1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Refreshing network info cache for port 7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Start _get_guest_xml network_info=[{"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:01:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1038281009',display_name='tempest-VolumesAdminNegativeTest-server-1038281009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1038281009',id=14,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584b479f01844391a15d9b00afc60453',ramdisk_id='',reservation_id='r-bwqi8362',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-540254454',owner_user_name='tempest-VolumesAdminNegativeTest-540254454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:03Z,user_data=None,user_id='82e025f0dc8745b3bf13231832816033',uuid=84cf389f-3a35-4e65-a7c9-7eb679c48df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converting VIF {"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'pci_devices' on Instance uuid 84cf389f-3a35-4e65-a7c9-7eb679c48df1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:01:04 user nova-compute[72793]:   <uuid>84cf389f-3a35-4e65-a7c9-7eb679c48df1</uuid>
Aug 17 04:01:04 user nova-compute[72793]:   <name>instance-0000000e</name>
Aug 17 04:01:04 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:01:04 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:01:04 user nova-compute[72793]:   <metadata>
Aug 17 04:01:04 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:01:04 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:01:04 user nova-compute[72793]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1038281009</nova:name>
Aug 17 04:01:04 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:01:04</nova:creationTime>
Aug 17 04:01:04 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:01:04 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:01:04 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:01:04 user nova-compute[72793]:       <nova:owner>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:user uuid="82e025f0dc8745b3bf13231832816033">tempest-VolumesAdminNegativeTest-540254454-project-member</nova:user>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:project uuid="584b479f01844391a15d9b00afc60453">tempest-VolumesAdminNegativeTest-540254454</nova:project>
Aug 17 04:01:04 user nova-compute[72793]:       </nova:owner>
Aug 17 04:01:04 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:01:04 user nova-compute[72793]:       <nova:ports>
Aug 17 04:01:04 user nova-compute[72793]:         <nova:port uuid="7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc">
Aug 17 04:01:04 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:01:04 user nova-compute[72793]:         </nova:port>
Aug 17 04:01:04 user nova-compute[72793]:       </nova:ports>
Aug 17 04:01:04 user nova-compute[72793]:     </nova:instance>
Aug 17 04:01:04 user nova-compute[72793]:   </metadata>
Aug 17 04:01:04 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:01:04 user nova-compute[72793]:     <system>
Aug 17 04:01:04 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:01:04 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:01:04 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:01:04 user nova-compute[72793]:       <entry name="serial">84cf389f-3a35-4e65-a7c9-7eb679c48df1</entry>
Aug 17 04:01:04 user nova-compute[72793]:       <entry name="uuid">84cf389f-3a35-4e65-a7c9-7eb679c48df1</entry>
Aug 17 04:01:04 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:01:04 user nova-compute[72793]:     </system>
Aug 17 04:01:04 user nova-compute[72793]:   </sysinfo>
Aug 17 04:01:04 user nova-compute[72793]:   <os>
Aug 17 04:01:04 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:01:04 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:01:04 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:01:04 user nova-compute[72793]:   </os>
Aug 17 04:01:04 user nova-compute[72793]:   <features>
Aug 17 04:01:04 user nova-compute[72793]:     <acpi/>
Aug 17 04:01:04 user nova-compute[72793]:     <apic/>
Aug 17 04:01:04 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:01:04 user nova-compute[72793]:   </features>
Aug 17 04:01:04 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:01:04 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:01:04 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:01:04 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:01:04 user nova-compute[72793]:   </clock>
Aug 17 04:01:04 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:01:04 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:01:04 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:01:04 user nova-compute[72793]:   </cpu>
Aug 17 04:01:04 user nova-compute[72793]:   <devices>
Aug 17 04:01:04 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:01:04 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:01:04 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk"/>
Aug 17 04:01:04 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:01:04 user nova-compute[72793]:     </disk>
Aug 17 04:01:04 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:01:04 user nova-compute[72793]:       <mac address="fa:16:3e:bf:77:3d"/>
Aug 17 04:01:04 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:04 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:01:04 user nova-compute[72793]:       <target dev="tap7a04f4d5-7d"/>
Aug 17 04:01:04 user nova-compute[72793]:     </interface>
Aug 17 04:01:04 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:01:04 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/console.log" append="off"/>
Aug 17 04:01:04 user nova-compute[72793]:     </serial>
Aug 17 04:01:04 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:01:04 user nova-compute[72793]:     <video>
Aug 17 04:01:04 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:04 user nova-compute[72793]:     </video>
Aug 17 04:01:04 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:01:04 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:01:04 user nova-compute[72793]:     </rng>
Aug 17 04:01:04 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:01:04 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:01:04 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:01:04 user nova-compute[72793]:     </memballoon>
Aug 17 04:01:04 user nova-compute[72793]:   </devices>
Aug 17 04:01:04 user nova-compute[72793]: </domain>
Aug 17 04:01:04 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1038281009',display_name='tempest-VolumesAdminNegativeTest-server-1038281009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1038281009',id=14,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584b479f01844391a15d9b00afc60453',ramdisk_id='',reservation_id='r-bwqi8362',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-540254454',owner_user_name='tempest-VolumesAdminNegativeTest-540254454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:03Z,user_data=None,user_id='82e025f0dc8745b3bf13231832816033',uuid=84cf389f-3a35-4e65-a7c9-7eb679c48df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converting VIF {"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG os_vif [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a04f4d5-7d, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a04f4d5-7d, col_values=(('external_ids', {'iface-id': '7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:77:3d', 'vm-uuid': '84cf389f-3a35-4e65-a7c9-7eb679c48df1'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:05 user nova-compute[72793]: INFO os_vif [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d')
Aug 17 04:01:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] No VIF found with MAC fa:16:3e:bf:77:3d, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-782874d8-b8b6-4ff6-b3cd-68edab815929 req-8d7cbd7c-fb5c-4b4e-9552-485935f629ea service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-782874d8-b8b6-4ff6-b3cd-68edab815929 req-8d7cbd7c-fb5c-4b4e-9552-485935f629ea service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-782874d8-b8b6-4ff6-b3cd-68edab815929 req-8d7cbd7c-fb5c-4b4e-9552-485935f629ea service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-782874d8-b8b6-4ff6-b3cd-68edab815929 req-8d7cbd7c-fb5c-4b4e-9552-485935f629ea service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-782874d8-b8b6-4ff6-b3cd-68edab815929 req-8d7cbd7c-fb5c-4b4e-9552-485935f629ea service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:05 user nova-compute[72793]: WARNING nova.compute.manager [req-782874d8-b8b6-4ff6-b3cd-68edab815929 req-8d7cbd7c-fb5c-4b4e-9552-485935f629ea service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state building and task_state spawning.
Aug 17 04:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Updated VIF entry in instance network info cache for port 7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Updating instance_info_cache with network_info: [{"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-86076047-f54c-425b-bb56-cd527135488d req-411d68cf-edd6-4aac-90ce-643b6ab68e09 service nova] Releasing lock "refresh_cache-84cf389f-3a35-4e65-a7c9-7eb679c48df1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating instance_info_cache with network_info: [{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:06 user nova-compute[72793]: INFO nova.compute.manager [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Terminating instance
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-375de076-b11c-4a69-ac63-03a0119aa8f1 req-82995c41-6ebf-4e31-8a22-4f76ac132c01 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-375de076-b11c-4a69-ac63-03a0119aa8f1 req-82995c41-6ebf-4e31-8a22-4f76ac132c01 service nova] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-375de076-b11c-4a69-ac63-03a0119aa8f1 req-82995c41-6ebf-4e31-8a22-4f76ac132c01 service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-375de076-b11c-4a69-ac63-03a0119aa8f1 req-82995c41-6ebf-4e31-8a22-4f76ac132c01 service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-375de076-b11c-4a69-ac63-03a0119aa8f1 req-82995c41-6ebf-4e31-8a22-4f76ac132c01 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] No waiting events found dispatching network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:06 user nova-compute[72793]: WARNING nova.compute.manager [req-375de076-b11c-4a69-ac63-03a0119aa8f1 req-82995c41-6ebf-4e31-8a22-4f76ac132c01 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received unexpected event network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc for instance with vm_state building and task_state spawning.
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-b237a0f7-4725-4814-9649-268c3752fbe0 req-631bed85-4a44-45ef-a722-20f98d487849 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b237a0f7-4725-4814-9649-268c3752fbe0 req-631bed85-4a44-45ef-a722-20f98d487849 service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b237a0f7-4725-4814-9649-268c3752fbe0 req-631bed85-4a44-45ef-a722-20f98d487849 service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b237a0f7-4725-4814-9649-268c3752fbe0 req-631bed85-4a44-45ef-a722-20f98d487849 service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-b237a0f7-4725-4814-9649-268c3752fbe0 req-631bed85-4a44-45ef-a722-20f98d487849 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:07 user nova-compute[72793]: WARNING nova.compute.manager [req-b237a0f7-4725-4814-9649-268c3752fbe0 req-631bed85-4a44-45ef-a722-20f98d487849 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state building and task_state spawning.
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-b4615c35-666a-4f2c-bcc2-a260341b446f req-ec9d59ec-0c25-4a0d-a8e6-287fb89a7c67 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-vif-unplugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b4615c35-666a-4f2c-bcc2-a260341b446f req-ec9d59ec-0c25-4a0d-a8e6-287fb89a7c67 service nova] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b4615c35-666a-4f2c-bcc2-a260341b446f req-ec9d59ec-0c25-4a0d-a8e6-287fb89a7c67 service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b4615c35-666a-4f2c-bcc2-a260341b446f req-ec9d59ec-0c25-4a0d-a8e6-287fb89a7c67 service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-b4615c35-666a-4f2c-bcc2-a260341b446f req-ec9d59ec-0c25-4a0d-a8e6-287fb89a7c67 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] No waiting events found dispatching network-vif-unplugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-b4615c35-666a-4f2c-bcc2-a260341b446f req-ec9d59ec-0c25-4a0d-a8e6-287fb89a7c67 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-vif-unplugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244867.308681, 245698d6-2693-404a-b365-e17fc5665259 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] VM Resumed (Lifecycle Event)
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance spawned successfully.
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244867.3088214, 245698d6-2693-404a-b365-e17fc5665259 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] VM Started (Lifecycle Event)
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Took 8.09 seconds to spawn the instance on the hypervisor.
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Took 9.12 seconds to build instance.
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Instance destroyed successfully.
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lazy-loading 'resources' on Instance uuid 2f348045-d3ba-409a-b57b-58bbdd86341c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a55e3118-852b-4e2c-9d81-5dbe5a1bd2f7 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.237s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1614138123',display_name='tempest-VolumesAssistedSnapshotsTest-server-1614138123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1614138123',id=5,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkzqeDXLfp7YXS7BsZj8d8e3rhLzmEDvl1Q/nWjavVlbDZhgPehTSdm2wxDo8myKXlyhRMqXFE6dhRFu8JGmJ/w2BBUYkiBj9pGxsAWTFvRLfZ/wOTH/Ky7/sWIRhdH/g==',key_name='tempest-keypair-861197071',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c795498241724a9f9784f66fa14a6b50',ramdisk_id='',reservation_id='r-edd51nx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1389464626',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1389464626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b32578702526492f8787da3739c7e292',uuid=2f348045-d3ba-409a-b57b-58bbdd86341c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Converting VIF {"id": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "address": "fa:16:3e:f1:4a:dd", "network": {"id": "52cbde1e-5f9b-4461-9a5c-51374d1dec22", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1920038617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c795498241724a9f9784f66fa14a6b50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfcb202e-d8", "ovs_interfaceid": "dfcb202e-d8ad-4753-9251-88500aa6ac09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG os_vif [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfcb202e-d8, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:07 user nova-compute[72793]: INFO os_vif [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:4a:dd,bridge_name='br-int',has_traffic_filtering=True,id=dfcb202e-d8ad-4753-9251-88500aa6ac09,network=Network(52cbde1e-5f9b-4461-9a5c-51374d1dec22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfcb202e-d8')
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Deleting instance files /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c_del
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Deletion of /opt/stack/data/nova/instances/2f348045-d3ba-409a-b57b-58bbdd86341c_del complete
Aug 17 04:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 04:01:07 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:01:07 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:08 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Took 1.18 seconds to deallocate network for instance.
Aug 17 04:01:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] No waiting events found dispatching network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:08 user nova-compute[72793]: WARNING nova.compute.manager [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received unexpected event network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc for instance with vm_state building and task_state spawning.
Aug 17 04:01:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-e53c8a40-d9ef-4c5b-ad49-63996591c3ba req-d6ecaf6d-96c4-4367-907e-f00e21d9a273 service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-vif-deleted-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-4e91500e-aad0-4031-9f45-0096c6003e46 req-4b6f242d-336d-476e-b776-559b3b10a53a service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received event network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4e91500e-aad0-4031-9f45-0096c6003e46 req-4b6f242d-336d-476e-b776-559b3b10a53a service nova] Acquiring lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4e91500e-aad0-4031-9f45-0096c6003e46 req-4b6f242d-336d-476e-b776-559b3b10a53a service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4e91500e-aad0-4031-9f45-0096c6003e46 req-4b6f242d-336d-476e-b776-559b3b10a53a service nova] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-4e91500e-aad0-4031-9f45-0096c6003e46 req-4b6f242d-336d-476e-b776-559b3b10a53a service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] No waiting events found dispatching network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:09 user nova-compute[72793]: WARNING nova.compute.manager [req-4e91500e-aad0-4031-9f45-0096c6003e46 req-4b6f242d-336d-476e-b776-559b3b10a53a service nova] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Received unexpected event network-vif-plugged-dfcb202e-d8ad-4753-9251-88500aa6ac09 for instance with vm_state deleted and task_state None.
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244869.2471354, 84cf389f-3a35-4e65-a7c9-7eb679c48df1 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] VM Resumed (Lifecycle Event)
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Instance spawned successfully.
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244869.2480156, 84cf389f-3a35-4e65-a7c9-7eb679c48df1 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] VM Started (Lifecycle Event)
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Deleted allocations for instance 2f348045-d3ba-409a-b57b-58bbdd86341c
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Took 8.40 seconds to build instance.
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ceabc062-ac10-4abb-97a2-f144f5d92bda tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.560s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9462f984-134a-4c97-af81-75dff38079a0 tempest-VolumesAssistedSnapshotsTest-1389464626 tempest-VolumesAssistedSnapshotsTest-1389464626-project-member] Lock "2f348045-d3ba-409a-b57b-58bbdd86341c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:09 user nova-compute[72793]: INFO nova.compute.manager [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Terminating instance
Aug 17 04:01:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Instance destroyed successfully.
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lazy-loading 'resources' on Instance uuid df59fea4-c74f-40c1-bc93-be5085413156 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-59fb6962-7f1b-4f99-8e47-8afe4d9e58ac req-6ffbc5ed-51f8-4cc5-9a5a-9a30a46749e4 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-unplugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59fb6962-7f1b-4f99-8e47-8afe4d9e58ac req-6ffbc5ed-51f8-4cc5-9a5a-9a30a46749e4 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59fb6962-7f1b-4f99-8e47-8afe4d9e58ac req-6ffbc5ed-51f8-4cc5-9a5a-9a30a46749e4 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59fb6962-7f1b-4f99-8e47-8afe4d9e58ac req-6ffbc5ed-51f8-4cc5-9a5a-9a30a46749e4 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-59fb6962-7f1b-4f99-8e47-8afe4d9e58ac req-6ffbc5ed-51f8-4cc5-9a5a-9a30a46749e4 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-unplugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-59fb6962-7f1b-4f99-8e47-8afe4d9e58ac req-6ffbc5ed-51f8-4cc5-9a5a-9a30a46749e4 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-unplugged-eb423df8-c512-4db6-8306-988514364769 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T03:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1405185482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1405185482',id=9,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMntunJ2273Jh1UpAiBvGcoQCsI4wsbRyt3NAyX4Cjv/3MepatXIpT2uvpoUrNqcuyEscHiQF927cSKLcwrhjsaY/s6O8rRQFfMK1zrRqtdhFt5ZzmV5wnXjH/6Z+f9Xsw==',key_name='tempest-keypair-1724505982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfc3fafd6d4541c1be05fc81ca6988dc',ramdisk_id='',reservation_id='r-z3hwfgmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1633838755',owner_user_name='tempest-TaggedAttachmentsTest-1633838755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f0cd34800034c5e9729e92f2388700d',uuid=df59fea4-c74f-40c1-bc93-be5085413156,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converting VIF {"id": "eb423df8-c512-4db6-8306-988514364769", "address": "fa:16:3e:fc:8d:cc", "network": {"id": "8ab43d7b-cb64-4693-b62b-7d85dcb38ce0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1504034883-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfc3fafd6d4541c1be05fc81ca6988dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb423df8-c5", "ovs_interfaceid": "eb423df8-c512-4db6-8306-988514364769", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG os_vif [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb423df8-c5, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:11 user nova-compute[72793]: INFO os_vif [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb423df8-c512-4db6-8306-988514364769,network=Network(8ab43d7b-cb64-4693-b62b-7d85dcb38ce0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb423df8-c5')
Aug 17 04:01:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Deleting instance files /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156_del
Aug 17 04:01:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Deletion of /opt/stack/data/nova/instances/df59fea4-c74f-40c1-bc93-be5085413156_del complete
Aug 17 04:01:11 user nova-compute[72793]: INFO nova.compute.manager [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 17 04:01:11 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:12 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:12 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Took 1.51 seconds to deallocate network for instance.
Aug 17 04:01:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-af6a5f3c-c3d9-4f45-8c86-7cdc3d765ae5 req-a8015a1f-323f-440b-a084-2b816b1d0564 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-deleted-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:12 user nova-compute[72793]: INFO nova.compute.manager [req-af6a5f3c-c3d9-4f45-8c86-7cdc3d765ae5 req-a8015a1f-323f-440b-a084-2b816b1d0564 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Neutron deleted interface eb423df8-c512-4db6-8306-988514364769; detaching it from the instance and deleting it from the info cache
Aug 17 04:01:12 user nova-compute[72793]: DEBUG nova.network.neutron [req-af6a5f3c-c3d9-4f45-8c86-7cdc3d765ae5 req-a8015a1f-323f-440b-a084-2b816b1d0564 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-af6a5f3c-c3d9-4f45-8c86-7cdc3d765ae5 req-a8015a1f-323f-440b-a084-2b816b1d0564 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Detach interface failed, port_id=eb423df8-c512-4db6-8306-988514364769, reason: Instance df59fea4-c74f-40c1-bc93-be5085413156 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:01:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:13 user nova-compute[72793]: WARNING nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 for instance with vm_state deleted and task_state None.
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:13 user nova-compute[72793]: WARNING nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 for instance with vm_state deleted and task_state None.
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:13 user nova-compute[72793]: WARNING nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 for instance with vm_state deleted and task_state None.
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Acquiring lock "df59fea4-c74f-40c1-bc93-be5085413156-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] Lock "df59fea4-c74f-40c1-bc93-be5085413156-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] No waiting events found dispatching network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:13 user nova-compute[72793]: WARNING nova.compute.manager [req-3be352d4-50cd-43c2-8af4-e036fc1d7248 req-70524dcc-a063-4b5d-8d99-ae8719a57819 service nova] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Received unexpected event network-vif-plugged-eb423df8-c512-4db6-8306-988514364769 for instance with vm_state deleted and task_state None.
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:13 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Deleted allocations for instance df59fea4-c74f-40c1-bc93-be5085413156
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:01:13 user nova-compute[72793]: INFO nova.compute.claims [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Claim successful on node user
Aug 17 04:01:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3bf1bce-23d2-4c3b-a6fd-0e1e401330eb tempest-TaggedAttachmentsTest-1633838755 tempest-TaggedAttachmentsTest-1633838755-project-member] Lock "df59fea4-c74f-40c1-bc93-be5085413156" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.709s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:01:14 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.policy [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65891e5eae334ee38675df619856db02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6b688c6c95499ab90009d73f378a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:01:14 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Creating image(s)
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.247s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk 1073741824" returned: 0 in 0.051s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.219s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Successfully created port: 4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:01:15 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:01:15 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:01:15 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a7f527-3801-45d3-82a5-d5406ba0d7e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:01:15 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3cdf1-6ad6-4e9b-9180-d3e446d263b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071] added
Aug 17 04:01:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[89914fe4-6638-4b8c-a4a2-8343c341c314]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c077cdb-3a37-48ea-857e-2bdcd50754dd]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRcNjTIp {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Cannot resize image /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'migration_context' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRcNjTIp" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[27099a62-d7d1-4973-9b2a-f5fc5193d41f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRcNjTIp'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Ensure instance console log exists: /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69a2db-c0d2-465f-a3bc-79838f01a812]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f12ff2b-f3fb-4c4c-b7cc-d1293d012e1c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e8f284-ded5-4b42-b057-333c11311a07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]
Aug 17 04:01:15 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.
Aug 17 04:01:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4299cd95-1a8e-4c79-bf01-0d02ada5c71b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2594800a-6a58-4182-b37b-208272b0f414]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:15 user nova-compute[72793]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:01:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:15 user nova-compute[72793]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:01:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d195d3-5d27-4428-a54a-f3550582b074]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:01:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Successfully updated port: 4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-changed-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Refreshing instance network info cache due to event network-changed-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] Acquiring lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] Acquired lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Refreshing network info cache for port 4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23735616166313239', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735616166313239', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'flavor' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:01:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:01:16 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:01:16 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:01:16 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:01:16 user nova-compute[72793]:   <serial>8b7bb4ef-1973-40d0-994c-b13795372071</serial>
Aug 17 04:01:16 user nova-compute[72793]: </disk>
Aug 17 04:01:16 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No VIF found with MAC fa:16:3e:73:21:bf, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b2545010-6673-4843-ab75-e49134544541 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.350s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG nova.network.neutron [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a2e08175-d7ba-4b64-bf33-6a3f1ae804ce req-ed5d75bf-8ae2-4f66-915d-a0cf110033e3 service nova] Releasing lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquired lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating instance_info_cache with network_info: [{"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Releasing lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance network_info: |[{"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Start _get_guest_xml network_info=[{"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:01:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780488707',display_name='tempest-tempest.common.compute-instance-780488707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-780488707',id=15,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVutA9Tlf0owhQuLQZK0QoDbulIgKPSwUdDttRITsXkGjWxHg/0URF8DFUdn+qiNuqMEbrZXqZbm7X9YC2/nPRdYJorxhdjSfVjua8acZNIGbvmKrQsrL6l9UwIXtnvUQ==',key_name='tempest-keypair-169977143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-d0ga5een',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=ecbd6261-7b55-4225-97c8-bbd02b37aa5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_devices' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:01:18 user nova-compute[72793]:   <uuid>ecbd6261-7b55-4225-97c8-bbd02b37aa5a</uuid>
Aug 17 04:01:18 user nova-compute[72793]:   <name>instance-0000000f</name>
Aug 17 04:01:18 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:01:18 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:01:18 user nova-compute[72793]:   <metadata>
Aug 17 04:01:18 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:01:18 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:01:18 user nova-compute[72793]:       <nova:name>tempest-tempest.common.compute-instance-780488707</nova:name>
Aug 17 04:01:18 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:01:18</nova:creationTime>
Aug 17 04:01:18 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:01:18 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:01:18 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:01:18 user nova-compute[72793]:       <nova:owner>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:user uuid="65891e5eae334ee38675df619856db02">tempest-ServerActionsTestOtherA-1498578162-project-member</nova:user>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:project uuid="8c6b688c6c95499ab90009d73f378a92">tempest-ServerActionsTestOtherA-1498578162</nova:project>
Aug 17 04:01:18 user nova-compute[72793]:       </nova:owner>
Aug 17 04:01:18 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:01:18 user nova-compute[72793]:       <nova:ports>
Aug 17 04:01:18 user nova-compute[72793]:         <nova:port uuid="4d8d064e-ed85-494d-a8aa-c53b4f37ecfa">
Aug 17 04:01:18 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:01:18 user nova-compute[72793]:         </nova:port>
Aug 17 04:01:18 user nova-compute[72793]:       </nova:ports>
Aug 17 04:01:18 user nova-compute[72793]:     </nova:instance>
Aug 17 04:01:18 user nova-compute[72793]:   </metadata>
Aug 17 04:01:18 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:01:18 user nova-compute[72793]:     <system>
Aug 17 04:01:18 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:01:18 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:01:18 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:01:18 user nova-compute[72793]:       <entry name="serial">ecbd6261-7b55-4225-97c8-bbd02b37aa5a</entry>
Aug 17 04:01:18 user nova-compute[72793]:       <entry name="uuid">ecbd6261-7b55-4225-97c8-bbd02b37aa5a</entry>
Aug 17 04:01:18 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:01:18 user nova-compute[72793]:     </system>
Aug 17 04:01:18 user nova-compute[72793]:   </sysinfo>
Aug 17 04:01:18 user nova-compute[72793]:   <os>
Aug 17 04:01:18 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:01:18 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:01:18 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:01:18 user nova-compute[72793]:   </os>
Aug 17 04:01:18 user nova-compute[72793]:   <features>
Aug 17 04:01:18 user nova-compute[72793]:     <acpi/>
Aug 17 04:01:18 user nova-compute[72793]:     <apic/>
Aug 17 04:01:18 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:01:18 user nova-compute[72793]:   </features>
Aug 17 04:01:18 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:01:18 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:01:18 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:01:18 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:01:18 user nova-compute[72793]:   </clock>
Aug 17 04:01:18 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:01:18 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:01:18 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:01:18 user nova-compute[72793]:   </cpu>
Aug 17 04:01:18 user nova-compute[72793]:   <devices>
Aug 17 04:01:18 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:01:18 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:01:18 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk"/>
Aug 17 04:01:18 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:01:18 user nova-compute[72793]:     </disk>
Aug 17 04:01:18 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:01:18 user nova-compute[72793]:       <mac address="fa:16:3e:a9:49:e1"/>
Aug 17 04:01:18 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:18 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:01:18 user nova-compute[72793]:       <target dev="tap4d8d064e-ed"/>
Aug 17 04:01:18 user nova-compute[72793]:     </interface>
Aug 17 04:01:18 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:01:18 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/console.log" append="off"/>
Aug 17 04:01:18 user nova-compute[72793]:     </serial>
Aug 17 04:01:18 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:01:18 user nova-compute[72793]:     <video>
Aug 17 04:01:18 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:18 user nova-compute[72793]:     </video>
Aug 17 04:01:18 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:01:18 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:01:18 user nova-compute[72793]:     </rng>
Aug 17 04:01:18 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:01:18 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:01:18 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:01:18 user nova-compute[72793]:     </memballoon>
Aug 17 04:01:18 user nova-compute[72793]:   </devices>
Aug 17 04:01:18 user nova-compute[72793]: </domain>
Aug 17 04:01:18 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780488707',display_name='tempest-tempest.common.compute-instance-780488707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-780488707',id=15,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVutA9Tlf0owhQuLQZK0QoDbulIgKPSwUdDttRITsXkGjWxHg/0URF8DFUdn+qiNuqMEbrZXqZbm7X9YC2/nPRdYJorxhdjSfVjua8acZNIGbvmKrQsrL6l9UwIXtnvUQ==',key_name='tempest-keypair-169977143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-d0ga5een',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=ecbd6261-7b55-4225-97c8-bbd02b37aa5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG os_vif [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d8d064e-ed, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d8d064e-ed, col_values=(('external_ids', {'iface-id': '4d8d064e-ed85-494d-a8aa-c53b4f37ecfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:49:e1', 'vm-uuid': 'ecbd6261-7b55-4225-97c8-bbd02b37aa5a'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:18 user nova-compute[72793]: INFO os_vif [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed')
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No VIF found with MAC fa:16:3e:a9:49:e1, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Stashing vm_state: active {{(pid=72793) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-f955d02c-a6de-40ab-b670-5b66badcb818 req-fcb3733b-8761-4251-aaff-02939e62477a service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f955d02c-a6de-40ab-b670-5b66badcb818 req-fcb3733b-8761-4251-aaff-02939e62477a service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f955d02c-a6de-40ab-b670-5b66badcb818 req-fcb3733b-8761-4251-aaff-02939e62477a service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f955d02c-a6de-40ab-b670-5b66badcb818 req-fcb3733b-8761-4251-aaff-02939e62477a service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-f955d02c-a6de-40ab-b670-5b66badcb818 req-fcb3733b-8761-4251-aaff-02939e62477a service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:20 user nova-compute[72793]: WARNING nova.compute.manager [req-f955d02c-a6de-40ab-b670-5b66badcb818 req-fcb3733b-8761-4251-aaff-02939e62477a service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state building and task_state spawning.
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'pci_requests' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:01:20 user nova-compute[72793]: INFO nova.compute.claims [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Claim successful on node user
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'resources' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'pci_devices' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:20 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating resource usage from migration ae6bc42d-08e4-4896-99de-5639f2272b63
Aug 17 04:01:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.554s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:21 user nova-compute[72793]: INFO nova.compute.manager [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Migrating
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:21 user nova-compute[72793]: INFO nova.compute.rpcapi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Starting migrate_disk_and_power_off {{(pid=72793) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-23921d23-b6cb-40a5-833d-0baf8430dd04 req-ff705171-5816-46e8-979b-8676a910a550 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23921d23-b6cb-40a5-833d-0baf8430dd04 req-ff705171-5816-46e8-979b-8676a910a550 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23921d23-b6cb-40a5-833d-0baf8430dd04 req-ff705171-5816-46e8-979b-8676a910a550 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-23921d23-b6cb-40a5-833d-0baf8430dd04 req-ff705171-5816-46e8-979b-8676a910a550 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-23921d23-b6cb-40a5-833d-0baf8430dd04 req-ff705171-5816-46e8-979b-8676a910a550 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:22 user nova-compute[72793]: WARNING nova.compute.manager [req-23921d23-b6cb-40a5-833d-0baf8430dd04 req-ff705171-5816-46e8-979b-8676a910a550 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state resize_migrating.
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244867.6176527, 2f348045-d3ba-409a-b57b-58bbdd86341c => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] VM Stopped (Lifecycle Event)
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244882.634361, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] VM Resumed (Lifecycle Event)
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c23c6cf5-1cfd-48d5-ba60-ef34c72e0d96 None None] [instance: 2f348045-d3ba-409a-b57b-58bbdd86341c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance spawned successfully.
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244882.637737, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] VM Started (Lifecycle Event)
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-a1319dda-b628-4632-b14b-d2a2f313fa83 req-f6d4737e-f7c1-4a32-8702-dd45f894a7cd service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a1319dda-b628-4632-b14b-d2a2f313fa83 req-f6d4737e-f7c1-4a32-8702-dd45f894a7cd service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a1319dda-b628-4632-b14b-d2a2f313fa83 req-f6d4737e-f7c1-4a32-8702-dd45f894a7cd service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a1319dda-b628-4632-b14b-d2a2f313fa83 req-f6d4737e-f7c1-4a32-8702-dd45f894a7cd service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-a1319dda-b628-4632-b14b-d2a2f313fa83 req-f6d4737e-f7c1-4a32-8702-dd45f894a7cd service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:22 user nova-compute[72793]: WARNING nova.compute.manager [req-a1319dda-b628-4632-b14b-d2a2f313fa83 req-f6d4737e-f7c1-4a32-8702-dd45f894a7cd service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state building and task_state spawning.
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Took 8.26 seconds to spawn the instance on the hypervisor.
Aug 17 04:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:22 user nova-compute[72793]: INFO nova.compute.manager [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Took 9.45 seconds to build instance.
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1ba14e29-baf8-456d-ba25-18d962ed0d42 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.733s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:23 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance destroyed successfully.
Aug 17 04:01:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:01:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf0e2da-57, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:23 user nova-compute[72793]: INFO os_vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57')
Aug 17 04:01:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:01:23 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3629e83b-b249-43c7-8f99-0e7190f33223]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[beedd3e4-1385-495f-8d27-d8f2fa713778]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:23 user nova-compute[72793]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:01:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:23 user nova-compute[72793]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:01:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07b8790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d44f7-ff35-4dd2-b346-42565cec5c1b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[db131916-b7c4-48b2-b1c6-657b7a7789e8]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee97670-bb8b-4373-bc3c-0c1756f247c5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2bb7b-ed71-4130-8652-bd627e50fa32]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbcf971-48c0-4a5f-9a32-782c02c270d1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8fdfbe-1b62-4c87-ba15-355c12c4d0a6]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]
Aug 17 04:01:23 user nova-compute[72793]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.
Aug 17 04:01:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc7b29-4a04-447e-b661-2e61abcae617]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== disconnect_volume: return (308ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:01:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c_resize/disk /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "cp -r /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c_resize/disk /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk" returned: 0 in 0.422s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c_resize/disk.info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk.info {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "cp -r /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c_resize/disk.info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk.info" returned: 0 in 0.045s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG nova.compute.manager [req-92750fb3-0342-4372-b35b-68403c6a2e0e req-58b72023-fc7d-438b-9bc5-23d1fc8b9aef service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-92750fb3-0342-4372-b35b-68403c6a2e0e req-58b72023-fc7d-438b-9bc5-23d1fc8b9aef service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-92750fb3-0342-4372-b35b-68403c6a2e0e req-58b72023-fc7d-438b-9bc5-23d1fc8b9aef service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-92750fb3-0342-4372-b35b-68403c6a2e0e req-58b72023-fc7d-438b-9bc5-23d1fc8b9aef service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:24 user nova-compute[72793]: DEBUG nova.compute.manager [req-92750fb3-0342-4372-b35b-68403c6a2e0e req-58b72023-fc7d-438b-9bc5-23d1fc8b9aef service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:24 user nova-compute[72793]: WARNING nova.compute.manager [req-92750fb3-0342-4372-b35b-68403c6a2e0e req-58b72023-fc7d-438b-9bc5-23d1fc8b9aef service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state resize_migrating.
Aug 17 04:01:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:25 user nova-compute[72793]: DEBUG nova.network.neutron [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Port fcf0e2da-57d4-4b11-8d5d-4410979612d7 binding to destination host user is already ACTIVE {{(pid=72793) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 04:01:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:26 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244871.043387, df59fea4-c74f-40c1-bc93-be5085413156 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:26 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: df59fea4-c74f-40c1-bc93-be5085413156] VM Stopped (Lifecycle Event)
Aug 17 04:01:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-535264b5-3767-4c4d-8937-6a64606ab82c None None] [instance: df59fea4-c74f-40c1-bc93-be5085413156] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:26 user nova-compute[72793]: DEBUG nova.network.neutron [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG nova.network.neutron [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG os_brick.utils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b3062-a001-49c7-aa4a-0d23256aee91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d45b5b1-7223-48ff-b88a-4bf4b675bbcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef7a87f-ab26-4ff3-b8a0-b3baf7c13a77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e30c32-3ee8-4e90-ba84-87b1ee8ecfdd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:01:27 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:01:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbca3c9-88df-486a-9580-12be91609006]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG os_brick.utils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:01:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:01:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:37 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:01:37 user nova-compute[72793]: INFO nova.compute.claims [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Claim successful on node user
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244883.017809, 07328c90-993b-4b0c-8673-04c850aae29c => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:38 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Stopped (Lifecycle Event)
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-16f00b60-fe10-42c8-a748-25641d22dafe None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-16f00b60-fe10-42c8-a748-25641d22dafe None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:38 user nova-compute[72793]: INFO nova.compute.manager [None req-16f00b60-fe10-42c8-a748-25641d22dafe None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 04:01:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:01:38 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.policy [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21663e2118004c528a64a7fba2e29ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec39bbf61f45c6963f018159dcb33c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:01:38 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Creating image(s)
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "/opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk 1073741824" returned: 0 in 0.048s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Successfully created port: 665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Cannot resize image /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'migration_context' on Instance uuid 210d0b74-53d8-45d4-b4b4-691c18fc125b {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Ensure instance console log exists: /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Successfully updated port: 665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-changed-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Refreshing instance network info cache due to event network-changed-665a8716-2a2e-4c84-b345-21a1c4e3b65d. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] Acquiring lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updating instance_info_cache with network_info: [{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Instance network_info: |[{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] Acquired lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.neutron [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Refreshing network info cache for port 665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Start _get_guest_xml network_info=[{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:01:40 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:40 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1070304473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1070304473',id=16,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-bi36ep3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:39Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=210d0b74-53d8-45d4-b4b4-691c18fc125b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'pci_devices' on Instance uuid 210d0b74-53d8-45d4-b4b4-691c18fc125b {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:01:40 user nova-compute[72793]:   <uuid>210d0b74-53d8-45d4-b4b4-691c18fc125b</uuid>
Aug 17 04:01:40 user nova-compute[72793]:   <name>instance-00000010</name>
Aug 17 04:01:40 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:01:40 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:01:40 user nova-compute[72793]:   <metadata>
Aug 17 04:01:40 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:01:40 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:01:40 user nova-compute[72793]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1070304473</nova:name>
Aug 17 04:01:40 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:01:40</nova:creationTime>
Aug 17 04:01:40 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:01:40 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:01:40 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:01:40 user nova-compute[72793]:       <nova:owner>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:user uuid="21663e2118004c528a64a7fba2e29ee3">tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member</nova:user>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:project uuid="a1ec39bbf61f45c6963f018159dcb33c">tempest-ServerBootFromVolumeStableRescueTest-1752371327</nova:project>
Aug 17 04:01:40 user nova-compute[72793]:       </nova:owner>
Aug 17 04:01:40 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:01:40 user nova-compute[72793]:       <nova:ports>
Aug 17 04:01:40 user nova-compute[72793]:         <nova:port uuid="665a8716-2a2e-4c84-b345-21a1c4e3b65d">
Aug 17 04:01:40 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 04:01:40 user nova-compute[72793]:         </nova:port>
Aug 17 04:01:40 user nova-compute[72793]:       </nova:ports>
Aug 17 04:01:40 user nova-compute[72793]:     </nova:instance>
Aug 17 04:01:40 user nova-compute[72793]:   </metadata>
Aug 17 04:01:40 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:01:40 user nova-compute[72793]:     <system>
Aug 17 04:01:40 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:01:40 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:01:40 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:01:40 user nova-compute[72793]:       <entry name="serial">210d0b74-53d8-45d4-b4b4-691c18fc125b</entry>
Aug 17 04:01:40 user nova-compute[72793]:       <entry name="uuid">210d0b74-53d8-45d4-b4b4-691c18fc125b</entry>
Aug 17 04:01:40 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:01:40 user nova-compute[72793]:     </system>
Aug 17 04:01:40 user nova-compute[72793]:   </sysinfo>
Aug 17 04:01:40 user nova-compute[72793]:   <os>
Aug 17 04:01:40 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:01:40 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:01:40 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:01:40 user nova-compute[72793]:   </os>
Aug 17 04:01:40 user nova-compute[72793]:   <features>
Aug 17 04:01:40 user nova-compute[72793]:     <acpi/>
Aug 17 04:01:40 user nova-compute[72793]:     <apic/>
Aug 17 04:01:40 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:01:40 user nova-compute[72793]:   </features>
Aug 17 04:01:40 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:01:40 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:01:40 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:01:40 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:01:40 user nova-compute[72793]:   </clock>
Aug 17 04:01:40 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:01:40 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:01:40 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:01:40 user nova-compute[72793]:   </cpu>
Aug 17 04:01:40 user nova-compute[72793]:   <devices>
Aug 17 04:01:40 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:01:40 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:01:40 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk"/>
Aug 17 04:01:40 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:01:40 user nova-compute[72793]:     </disk>
Aug 17 04:01:40 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:01:40 user nova-compute[72793]:       <mac address="fa:16:3e:5f:f8:c5"/>
Aug 17 04:01:40 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:40 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:01:40 user nova-compute[72793]:       <target dev="tap665a8716-2a"/>
Aug 17 04:01:40 user nova-compute[72793]:     </interface>
Aug 17 04:01:40 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:01:40 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/console.log" append="off"/>
Aug 17 04:01:40 user nova-compute[72793]:     </serial>
Aug 17 04:01:40 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:01:40 user nova-compute[72793]:     <video>
Aug 17 04:01:40 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:40 user nova-compute[72793]:     </video>
Aug 17 04:01:40 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:01:40 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:01:40 user nova-compute[72793]:     </rng>
Aug 17 04:01:40 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:01:40 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:01:40 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:01:40 user nova-compute[72793]:     </memballoon>
Aug 17 04:01:40 user nova-compute[72793]:   </devices>
Aug 17 04:01:40 user nova-compute[72793]: </domain>
Aug 17 04:01:40 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1070304473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1070304473',id=16,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-bi36ep3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:39Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=210d0b74-53d8-45d4-b4b4-691c18fc125b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG os_vif [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap665a8716-2a, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap665a8716-2a, col_values=(('external_ids', {'iface-id': '665a8716-2a2e-4c84-b345-21a1c4e3b65d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:f8:c5', 'vm-uuid': '210d0b74-53d8-45d4-b4b4-691c18fc125b'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:40 user nova-compute[72793]: INFO os_vif [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a')
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No VIF found with MAC fa:16:3e:5f:f8:c5, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updated VIF entry in instance network info cache for port 665a8716-2a2e-4c84-b345-21a1c4e3b65d. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:01:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updating instance_info_cache with network_info: [{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ceff04e7-c0b1-49bf-89ed-7eb5b1814411 req-e0833ed1-c1de-4a44-9805-fdbedda5dc6a service nova] Releasing lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-0d3e744f-88dd-4246-b0ff-c65df2145226 req-e341389d-c50a-472b-940c-6b8603679772 service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0d3e744f-88dd-4246-b0ff-c65df2145226 req-e341389d-c50a-472b-940c-6b8603679772 service nova] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0d3e744f-88dd-4246-b0ff-c65df2145226 req-e341389d-c50a-472b-940c-6b8603679772 service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0d3e744f-88dd-4246-b0ff-c65df2145226 req-e341389d-c50a-472b-940c-6b8603679772 service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-0d3e744f-88dd-4246-b0ff-c65df2145226 req-e341389d-c50a-472b-940c-6b8603679772 service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] No waiting events found dispatching network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:42 user nova-compute[72793]: WARNING nova.compute.manager [req-0d3e744f-88dd-4246-b0ff-c65df2145226 req-e341389d-c50a-472b-940c-6b8603679772 service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received unexpected event network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d for instance with vm_state building and task_state spawning.
Aug 17 04:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244904.2087116, 210d0b74-53d8-45d4-b4b4-691c18fc125b => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] VM Resumed (Lifecycle Event)
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Instance spawned successfully.
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-84d61b2c-7384-4651-9a6d-5398561b320c req-cd1ebb58-ee8d-4da2-a198-c5fc8393f94c service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84d61b2c-7384-4651-9a6d-5398561b320c req-cd1ebb58-ee8d-4da2-a198-c5fc8393f94c service nova] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84d61b2c-7384-4651-9a6d-5398561b320c req-cd1ebb58-ee8d-4da2-a198-c5fc8393f94c service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84d61b2c-7384-4651-9a6d-5398561b320c req-cd1ebb58-ee8d-4da2-a198-c5fc8393f94c service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-84d61b2c-7384-4651-9a6d-5398561b320c req-cd1ebb58-ee8d-4da2-a198-c5fc8393f94c service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] No waiting events found dispatching network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:44 user nova-compute[72793]: WARNING nova.compute.manager [req-84d61b2c-7384-4651-9a6d-5398561b320c req-cd1ebb58-ee8d-4da2-a198-c5fc8393f94c service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received unexpected event network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d for instance with vm_state building and task_state spawning.
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244904.2090015, 210d0b74-53d8-45d4-b4b4-691c18fc125b => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] VM Started (Lifecycle Event)
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 17 04:01:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:01:44 user nova-compute[72793]: INFO nova.compute.manager [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Took 6.75 seconds to build instance.
Aug 17 04:01:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8acf64ad-29cf-4df7-b61f-d8fff3b260af tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.854s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Starting finish_migration {{(pid=72793) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 04:01:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:01:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Creating image(s)
Aug 17 04:01:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'trusted_certs' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:47 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk. size=21474836480 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:01:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk 21474836480 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk 21474836480" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Ensure instance console log exists: /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start _get_guest_xml network_info=[{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '07328c90-993b-4b0c-8673-04c850aae29c', 'attached_at': '2023-08-17T04:01:47.000000', 'detached_at': '', 'volume_id': '8b7bb4ef-1973-40d0-994c-b13795372071', 'serial': '8b7bb4ef-1973-40d0-994c-b13795372071'}, 'guest_format': None, 'attachment_id': 'ec8b50bb-4023-4831-9740-dc7bc4290f66', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:01:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:01:48 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:01:48 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:01:48 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b2139a-55ad-4456-bc42-923af899378a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:01:48 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d90be-8174-4a9b-b743-22d879b56dfb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071] added
Aug 17 04:01:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[502ee1f0-5161-4fca-9e66-3b0e24fd898f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[74baa6c6-a909-43c6-a7c9-075a01bc175a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRcNjTIp {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRcNjTIp" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29138e9-e0b4-4d53-a765-62de334ee365]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRcNjTIp'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dffc71-4ec7-4066-ab1a-772447fb4394]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1656064a-76eb-4f32-9c31-28e4ceb63a8c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4f3b6-c299-42c6-be65-84c4138a949c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]
Aug 17 04:01:48 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.
Aug 17 04:01:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e4c57-6e90-49b8-996e-08a5a057ccd2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:48 user nova-compute[72793]: INFO nova.compute.manager [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Terminating instance
Aug 17 04:01:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af35c64-fca3-467c-a6de-102bf18310a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:48 user nova-compute[72793]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:01:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:01:48 user nova-compute[72793]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:01:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[427c410b-8bc9-4ed7-90a3-3429c5edca9b]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-a06e129e-b889-4967-8afd-3daf44753f52 req-45feaaa0-2717-437b-99fd-03df786ee914 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-vif-unplugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a06e129e-b889-4967-8afd-3daf44753f52 req-45feaaa0-2717-437b-99fd-03df786ee914 service nova] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a06e129e-b889-4967-8afd-3daf44753f52 req-45feaaa0-2717-437b-99fd-03df786ee914 service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a06e129e-b889-4967-8afd-3daf44753f52 req-45feaaa0-2717-437b-99fd-03df786ee914 service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-a06e129e-b889-4967-8afd-3daf44753f52 req-45feaaa0-2717-437b-99fd-03df786ee914 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] No waiting events found dispatching network-vif-unplugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-a06e129e-b889-4967-8afd-3daf44753f52 req-45feaaa0-2717-437b-99fd-03df786ee914 service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-vif-unplugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:01:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Instance destroyed successfully.
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lazy-loading 'resources' on Instance uuid 8ef016ce-07e3-4fe1-8b99-29cce6862f55 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-748305668',display_name='tempest-TestVolumeSwap-server-748305668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-748305668',id=8,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEotFc7rY+clpL/s5uPuq26wWiUz6OdWPeVJ0AD/TPJE6V7vyIZtXhSLSGrFnGGwCCCDVJ7h2936fgat8e5h9ln8NKBJzEtfKqzn2Q4d08BJHfiklTqlSM9rJnR6/jnG+w==',key_name='tempest-keypair-1550518975',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ba4c7a79ab24dd18dff838b38a523d4',ramdisk_id='',reservation_id='r-pnl9klxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-176402644',owner_user_name='tempest-TestVolumeSwap-176402644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c5f4dca85614dab85fc905ed14874cc',uuid=8ef016ce-07e3-4fe1-8b99-29cce6862f55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Converting VIF {"id": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "address": "fa:16:3e:d4:61:ff", "network": {"id": "8ff2583f-22be-4d62-842b-b16bdbd6f63d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1435576499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ba4c7a79ab24dd18dff838b38a523d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdefbfa96-c0", "ovs_interfaceid": "defbfa96-c0e2-4651-9ac4-3bff083973d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG os_vif [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdefbfa96-c0, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: INFO os_vif [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:61:ff,bridge_name='br-int',has_traffic_filtering=True,id=defbfa96-c0e2-4651-9ac4-3bff083973d0,network=Network(8ff2583f-22be-4d62-842b-b16bdbd6f63d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdefbfa96-c0')
Aug 17 04:01:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Deleting instance files /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55_del
Aug 17 04:01:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Deletion of /opt/stack/data/nova/instances/8ef016ce-07e3-4fe1-8b99-29cce6862f55_del complete
Aug 17 04:01:49 user nova-compute[72793]: INFO nova.compute.manager [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 04:01:49 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23735616166313239', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735616166313239', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:01:49 user nova-compute[72793]:   <uuid>07328c90-993b-4b0c-8673-04c850aae29c</uuid>
Aug 17 04:01:49 user nova-compute[72793]:   <name>instance-00000002</name>
Aug 17 04:01:49 user nova-compute[72793]:   <memory>2097152</memory>
Aug 17 04:01:49 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:01:49 user nova-compute[72793]:   <metadata>
Aug 17 04:01:49 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:01:49 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:01:49 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherB-server-276616593</nova:name>
Aug 17 04:01:49 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:01:48</nova:creationTime>
Aug 17 04:01:49 user nova-compute[72793]:       <nova:flavor name="m1.small">
Aug 17 04:01:49 user nova-compute[72793]:         <nova:memory>2048</nova:memory>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:disk>20</nova:disk>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:01:49 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:01:49 user nova-compute[72793]:       <nova:owner>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:user uuid="ad95533bd5634f7384f9c9f58a9aaf81">tempest-ServerActionsTestOtherB-1791175768-project-member</nova:user>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:project uuid="5b799dd936be46aab2513974c488ae92">tempest-ServerActionsTestOtherB-1791175768</nova:project>
Aug 17 04:01:49 user nova-compute[72793]:       </nova:owner>
Aug 17 04:01:49 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:01:49 user nova-compute[72793]:       <nova:ports>
Aug 17 04:01:49 user nova-compute[72793]:         <nova:port uuid="fcf0e2da-57d4-4b11-8d5d-4410979612d7">
Aug 17 04:01:49 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:01:49 user nova-compute[72793]:         </nova:port>
Aug 17 04:01:49 user nova-compute[72793]:       </nova:ports>
Aug 17 04:01:49 user nova-compute[72793]:     </nova:instance>
Aug 17 04:01:49 user nova-compute[72793]:   </metadata>
Aug 17 04:01:49 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:01:49 user nova-compute[72793]:     <system>
Aug 17 04:01:49 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:01:49 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:01:49 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:01:49 user nova-compute[72793]:       <entry name="serial">07328c90-993b-4b0c-8673-04c850aae29c</entry>
Aug 17 04:01:49 user nova-compute[72793]:       <entry name="uuid">07328c90-993b-4b0c-8673-04c850aae29c</entry>
Aug 17 04:01:49 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:01:49 user nova-compute[72793]:     </system>
Aug 17 04:01:49 user nova-compute[72793]:   </sysinfo>
Aug 17 04:01:49 user nova-compute[72793]:   <os>
Aug 17 04:01:49 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:01:49 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:01:49 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:01:49 user nova-compute[72793]:   </os>
Aug 17 04:01:49 user nova-compute[72793]:   <features>
Aug 17 04:01:49 user nova-compute[72793]:     <acpi/>
Aug 17 04:01:49 user nova-compute[72793]:     <apic/>
Aug 17 04:01:49 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:01:49 user nova-compute[72793]:   </features>
Aug 17 04:01:49 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:01:49 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:01:49 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:01:49 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:01:49 user nova-compute[72793]:   </clock>
Aug 17 04:01:49 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:01:49 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:01:49 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:01:49 user nova-compute[72793]:   </cpu>
Aug 17 04:01:49 user nova-compute[72793]:   <devices>
Aug 17 04:01:49 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:01:49 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:01:49 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk"/>
Aug 17 04:01:49 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:01:49 user nova-compute[72793]:     </disk>
Aug 17 04:01:49 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:01:49 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:01:49 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:01:49 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:01:49 user nova-compute[72793]:       <serial>8b7bb4ef-1973-40d0-994c-b13795372071</serial>
Aug 17 04:01:49 user nova-compute[72793]:     </disk>
Aug 17 04:01:49 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:01:49 user nova-compute[72793]:       <mac address="fa:16:3e:73:21:bf"/>
Aug 17 04:01:49 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:49 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:01:49 user nova-compute[72793]:       <target dev="tapfcf0e2da-57"/>
Aug 17 04:01:49 user nova-compute[72793]:     </interface>
Aug 17 04:01:49 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:01:49 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/console.log" append="off"/>
Aug 17 04:01:49 user nova-compute[72793]:     </serial>
Aug 17 04:01:49 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:01:49 user nova-compute[72793]:     <video>
Aug 17 04:01:49 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:49 user nova-compute[72793]:     </video>
Aug 17 04:01:49 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:01:49 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:01:49 user nova-compute[72793]:     </rng>
Aug 17 04:01:49 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:01:49 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:01:49 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:01:49 user nova-compute[72793]:     </memballoon>
Aug 17 04:01:49 user nova-compute[72793]:   </devices>
Aug 17 04:01:49 user nova-compute[72793]: </domain>
Aug 17 04:01:49 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-333557076-network", "vif_mac": "fa:16:3e:73:21:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG os_vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf0e2da-57, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcf0e2da-57, col_values=(('external_ids', {'iface-id': 'fcf0e2da-57d4-4b11-8d5d-4410979612d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:21:bf', 'vm-uuid': '07328c90-993b-4b0c-8673-04c850aae29c'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:49 user nova-compute[72793]: INFO os_vif [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57')
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] No VIF found with MAC fa:16:3e:73:21:bf, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:50 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:50 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Took 1.13 seconds to deallocate network for instance.
Aug 17 04:01:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] Acquiring lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] No waiting events found dispatching network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:51 user nova-compute[72793]: WARNING nova.compute.manager [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received unexpected event network-vif-plugged-defbfa96-c0e2-4651-9ac4-3bff083973d0 for instance with vm_state deleted and task_state None.
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebe49ab4-6de7-43d2-ad71-a025aaf797e8 req-765d66b9-a569-438a-959f-f92cbce2069b service nova] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Received event network-vif-deleted-defbfa96-c0e2-4651-9ac4-3bff083973d0 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:51 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Deleted allocations for instance 8ef016ce-07e3-4fe1-8b99-29cce6862f55
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3da99b48-86fc-4243-b718-c506c20e8bd6 tempest-TestVolumeSwap-176402644 tempest-TestVolumeSwap-176402644-project-member] Lock "8ef016ce-07e3-4fe1-8b99-29cce6862f55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.831s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-764462b3-7e17-4125-b546-af3baa15d196 req-7860d4b5-992b-4856-922e-8f15eb63cf53 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-764462b3-7e17-4125-b546-af3baa15d196 req-7860d4b5-992b-4856-922e-8f15eb63cf53 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-764462b3-7e17-4125-b546-af3baa15d196 req-7860d4b5-992b-4856-922e-8f15eb63cf53 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-764462b3-7e17-4125-b546-af3baa15d196 req-7860d4b5-992b-4856-922e-8f15eb63cf53 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-764462b3-7e17-4125-b546-af3baa15d196 req-7860d4b5-992b-4856-922e-8f15eb63cf53 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:51 user nova-compute[72793]: WARNING nova.compute.manager [req-764462b3-7e17-4125-b546-af3baa15d196 req-7860d4b5-992b-4856-922e-8f15eb63cf53 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state resize_finish.
Aug 17 04:01:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244913.868113, 07328c90-993b-4b0c-8673-04c850aae29c => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:53 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Resumed (Lifecycle Event)
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:01:53 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance running successfully.
Aug 17 04:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Failed to set time: agent not configured {{(pid=72793) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-203244fe-2e32-48d4-9c36-d7ae66f9efdf tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] finish_migration finished successfully. {{(pid=72793) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-0c4f8abb-32a9-42be-a2a9-f805a77bc501 req-b73eb0e8-0c60-4592-a276-24dee5dfba76 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0c4f8abb-32a9-42be-a2a9-f805a77bc501 req-b73eb0e8-0c60-4592-a276-24dee5dfba76 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0c4f8abb-32a9-42be-a2a9-f805a77bc501 req-b73eb0e8-0c60-4592-a276-24dee5dfba76 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0c4f8abb-32a9-42be-a2a9-f805a77bc501 req-b73eb0e8-0c60-4592-a276-24dee5dfba76 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-0c4f8abb-32a9-42be-a2a9-f805a77bc501 req-b73eb0e8-0c60-4592-a276-24dee5dfba76 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:53 user nova-compute[72793]: WARNING nova.compute.manager [req-0c4f8abb-32a9-42be-a2a9-f805a77bc501 req-b73eb0e8-0c60-4592-a276-24dee5dfba76 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state resize_finish.
Aug 17 04:01:53 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 04:01:53 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244913.8725035, 07328c90-993b-4b0c-8673-04c850aae29c => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:01:53 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Started (Lifecycle Event)
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:01:54 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:01:54 user nova-compute[72793]: INFO nova.compute.claims [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Claim successful on node user
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:54 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.policy [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ab04a3f7b5a49a18611842d9b17caee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77bee286a962408b835f909f54ed13c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:01:54 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Creating image(s)
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "/opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "/opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.223s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk 1073741824" returned: 0 in 0.058s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Successfully created port: e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Cannot resize image /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'migration_context' on Instance uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Ensure instance console log exists: /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Successfully updated port: e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquired lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-changed-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Refreshing instance network info cache due to event network-changed-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] Acquiring lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:01:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updating instance_info_cache with network_info: [{"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Releasing lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Instance network_info: |[{"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] Acquired lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Refreshing network info cache for port e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Start _get_guest_xml network_info=[{"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:01:57 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:57 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1830791366',display_name='tempest-VolumesSnapshotTestJSON-instance-1830791366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1830791366',id=17,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIe6PMnGfB0S37233odrUTW9674R4yZxseoFp1CUng0kvsEwiX9GnnO9qxv4lewbQjSqZmO1o06BmO6WR5EzCe8DCpsiHbVIOZZzM5sULxlKLCIA99nIfBwyCjdYOedbQ==',key_name='tempest-keypair-653829853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bee286a962408b835f909f54ed13c1',ramdisk_id='',reservation_id='r-s73vy4vf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1354726728',owner_user_name='tempest-VolumesSnapshotTestJSON-1354726728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab04a3f7b5a49a18611842d9b17caee',uuid=bc92c36f-acd0-417c-b8fd-8be00f5daa3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converting VIF {"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.objects.instance [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'pci_devices' on Instance uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:01:57 user nova-compute[72793]:   <uuid>bc92c36f-acd0-417c-b8fd-8be00f5daa3c</uuid>
Aug 17 04:01:57 user nova-compute[72793]:   <name>instance-00000011</name>
Aug 17 04:01:57 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:01:57 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:01:57 user nova-compute[72793]:   <metadata>
Aug 17 04:01:57 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:01:57 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:01:57 user nova-compute[72793]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1830791366</nova:name>
Aug 17 04:01:57 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:01:57</nova:creationTime>
Aug 17 04:01:57 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:01:57 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:01:57 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:01:57 user nova-compute[72793]:       <nova:owner>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:user uuid="3ab04a3f7b5a49a18611842d9b17caee">tempest-VolumesSnapshotTestJSON-1354726728-project-member</nova:user>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:project uuid="77bee286a962408b835f909f54ed13c1">tempest-VolumesSnapshotTestJSON-1354726728</nova:project>
Aug 17 04:01:57 user nova-compute[72793]:       </nova:owner>
Aug 17 04:01:57 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:01:57 user nova-compute[72793]:       <nova:ports>
Aug 17 04:01:57 user nova-compute[72793]:         <nova:port uuid="e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76">
Aug 17 04:01:57 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:01:57 user nova-compute[72793]:         </nova:port>
Aug 17 04:01:57 user nova-compute[72793]:       </nova:ports>
Aug 17 04:01:57 user nova-compute[72793]:     </nova:instance>
Aug 17 04:01:57 user nova-compute[72793]:   </metadata>
Aug 17 04:01:57 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:01:57 user nova-compute[72793]:     <system>
Aug 17 04:01:57 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:01:57 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:01:57 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:01:57 user nova-compute[72793]:       <entry name="serial">bc92c36f-acd0-417c-b8fd-8be00f5daa3c</entry>
Aug 17 04:01:57 user nova-compute[72793]:       <entry name="uuid">bc92c36f-acd0-417c-b8fd-8be00f5daa3c</entry>
Aug 17 04:01:57 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:01:57 user nova-compute[72793]:     </system>
Aug 17 04:01:57 user nova-compute[72793]:   </sysinfo>
Aug 17 04:01:57 user nova-compute[72793]:   <os>
Aug 17 04:01:57 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:01:57 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:01:57 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:01:57 user nova-compute[72793]:   </os>
Aug 17 04:01:57 user nova-compute[72793]:   <features>
Aug 17 04:01:57 user nova-compute[72793]:     <acpi/>
Aug 17 04:01:57 user nova-compute[72793]:     <apic/>
Aug 17 04:01:57 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:01:57 user nova-compute[72793]:   </features>
Aug 17 04:01:57 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:01:57 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:01:57 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:01:57 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:01:57 user nova-compute[72793]:   </clock>
Aug 17 04:01:57 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:01:57 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:01:57 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:01:57 user nova-compute[72793]:   </cpu>
Aug 17 04:01:57 user nova-compute[72793]:   <devices>
Aug 17 04:01:57 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:01:57 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:01:57 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk"/>
Aug 17 04:01:57 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:01:57 user nova-compute[72793]:     </disk>
Aug 17 04:01:57 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:01:57 user nova-compute[72793]:       <mac address="fa:16:3e:2d:06:fb"/>
Aug 17 04:01:57 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:57 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:01:57 user nova-compute[72793]:       <target dev="tape1a85a7d-fd"/>
Aug 17 04:01:57 user nova-compute[72793]:     </interface>
Aug 17 04:01:57 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:01:57 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/console.log" append="off"/>
Aug 17 04:01:57 user nova-compute[72793]:     </serial>
Aug 17 04:01:57 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:01:57 user nova-compute[72793]:     <video>
Aug 17 04:01:57 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:01:57 user nova-compute[72793]:     </video>
Aug 17 04:01:57 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:01:57 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:01:57 user nova-compute[72793]:     </rng>
Aug 17 04:01:57 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:01:57 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:01:57 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:01:57 user nova-compute[72793]:     </memballoon>
Aug 17 04:01:57 user nova-compute[72793]:   </devices>
Aug 17 04:01:57 user nova-compute[72793]: </domain>
Aug 17 04:01:57 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1830791366',display_name='tempest-VolumesSnapshotTestJSON-instance-1830791366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1830791366',id=17,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIe6PMnGfB0S37233odrUTW9674R4yZxseoFp1CUng0kvsEwiX9GnnO9qxv4lewbQjSqZmO1o06BmO6WR5EzCe8DCpsiHbVIOZZzM5sULxlKLCIA99nIfBwyCjdYOedbQ==',key_name='tempest-keypair-653829853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bee286a962408b835f909f54ed13c1',ramdisk_id='',reservation_id='r-s73vy4vf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1354726728',owner_user_name='tempest-VolumesSnapshotTestJSON-1354726728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab04a3f7b5a49a18611842d9b17caee',uuid=bc92c36f-acd0-417c-b8fd-8be00f5daa3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converting VIF {"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG os_vif [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1a85a7d-fd, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1a85a7d-fd, col_values=(('external_ids', {'iface-id': 'e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:06:fb', 'vm-uuid': 'bc92c36f-acd0-417c-b8fd-8be00f5daa3c'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:57 user nova-compute[72793]: INFO os_vif [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd')
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:01:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No VIF found with MAC fa:16:3e:2d:06:fb, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG nova.network.neutron [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updated VIF entry in instance network info cache for port e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG nova.network.neutron [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updating instance_info_cache with network_info: [{"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-30fa997d-707e-462c-a5df-f4074ff99d1c req-b54c8d84-42a9-430f-9277-e48ee9ac7f78 service nova] Releasing lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-9d2c42b7-6c81-4c2a-bae4-6561d4e4a8f6 req-702403a0-a8f8-4aee-9aa9-762996672ef0 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9d2c42b7-6c81-4c2a-bae4-6561d4e4a8f6 req-702403a0-a8f8-4aee-9aa9-762996672ef0 service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9d2c42b7-6c81-4c2a-bae4-6561d4e4a8f6 req-702403a0-a8f8-4aee-9aa9-762996672ef0 service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9d2c42b7-6c81-4c2a-bae4-6561d4e4a8f6 req-702403a0-a8f8-4aee-9aa9-762996672ef0 service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-9d2c42b7-6c81-4c2a-bae4-6561d4e4a8f6 req-702403a0-a8f8-4aee-9aa9-762996672ef0 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:01:59 user nova-compute[72793]: WARNING nova.compute.manager [req-9d2c42b7-6c81-4c2a-bae4-6561d4e4a8f6 req-702403a0-a8f8-4aee-9aa9-762996672ef0 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state building and task_state spawning.
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:01:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244921.5294158, bc92c36f-acd0-417c-b8fd-8be00f5daa3c => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] VM Resumed (Lifecycle Event)
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Instance spawned successfully.
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692244921.5305657, bc92c36f-acd0-417c-b8fd-8be00f5daa3c => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] VM Started (Lifecycle Event)
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 17 04:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:01 user nova-compute[72793]: INFO nova.compute.manager [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Took 7.82 seconds to build instance.
Aug 17 04:02:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10702d74-28b6-440e-9ffb-4ab15cd27366 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.029s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-a465c0e8-7bf0-4e05-93d4-8b1534a2133a req-a983be07-84ce-4740-b8ca-64d3f9a6c1cb service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a465c0e8-7bf0-4e05-93d4-8b1534a2133a req-a983be07-84ce-4740-b8ca-64d3f9a6c1cb service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a465c0e8-7bf0-4e05-93d4-8b1534a2133a req-a983be07-84ce-4740-b8ca-64d3f9a6c1cb service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a465c0e8-7bf0-4e05-93d4-8b1534a2133a req-a983be07-84ce-4740-b8ca-64d3f9a6c1cb service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-a465c0e8-7bf0-4e05-93d4-8b1534a2133a req-a983be07-84ce-4740-b8ca-64d3f9a6c1cb service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:02:02 user nova-compute[72793]: WARNING nova.compute.manager [req-a465c0e8-7bf0-4e05-93d4-8b1534a2133a req-a983be07-84ce-4740-b8ca-64d3f9a6c1cb service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state active and task_state None.
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:02:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:02:04 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7162MB free_disk=25.685638427734375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Applying migration context for instance 07328c90-993b-4b0c-8673-04c850aae29c as it has an incoming, in-progress migration ae6bc42d-08e4-4896-99de-5639f2272b63. Migration status is finished {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 04:02:04 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating resource usage from migration ae6bc42d-08e4-4896-99de-5639f2272b63
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28306d00-a9c4-4395-b2db-e4b59e035f6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 245698d6-2693-404a-b365-e17fc5665259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 84cf389f-3a35-4e65-a7c9-7eb679c48df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Migration ae6bc42d-08e4-4896-99de-5639f2272b63 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244909.4168243, 8ef016ce-07e3-4fe1-8b99-29cce6862f55 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:02:04 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] VM Stopped (Lifecycle Event)
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af073abe-a5a6-424e-9b05-d85f1aca5693 None None] [instance: 8ef016ce-07e3-4fe1-8b99-29cce6862f55] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:02:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:02:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:23 user nova-compute[72793]: INFO nova.compute.manager [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Terminating instance
Aug 17 04:02:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-93313250-15f6-4610-986e-fb8784ef3f3b req-0f49cbb6-7208-4cd2-ae06-94193280ab10 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-vif-unplugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93313250-15f6-4610-986e-fb8784ef3f3b req-0f49cbb6-7208-4cd2-ae06-94193280ab10 service nova] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93313250-15f6-4610-986e-fb8784ef3f3b req-0f49cbb6-7208-4cd2-ae06-94193280ab10 service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93313250-15f6-4610-986e-fb8784ef3f3b req-0f49cbb6-7208-4cd2-ae06-94193280ab10 service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-93313250-15f6-4610-986e-fb8784ef3f3b req-0f49cbb6-7208-4cd2-ae06-94193280ab10 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] No waiting events found dispatching network-vif-unplugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:02:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-93313250-15f6-4610-986e-fb8784ef3f3b req-0f49cbb6-7208-4cd2-ae06-94193280ab10 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-vif-unplugged-dbb2255d-474a-4c91-b153-077161406df7 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:02:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Instance destroyed successfully.
Aug 17 04:02:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lazy-loading 'resources' on Instance uuid 28306d00-a9c4-4395-b2db-e4b59e035f6a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-60902547',display_name='tempest-VolumesActionsTest-instance-60902547',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-60902547',id=12,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:00:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='163e4f83cf6c496daaefcf07f2458334',ramdisk_id='',reservation_id='r-ie7uf60k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2053759356',owner_user_name='tempest-VolumesActionsTest-2053759356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:00:36Z,user_data=None,user_id='b417e88ac27f494997b2d548630a4799',uuid=28306d00-a9c4-4395-b2db-e4b59e035f6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converting VIF {"id": "dbb2255d-474a-4c91-b153-077161406df7", "address": "fa:16:3e:2e:96:ef", "network": {"id": "6ca2c535-79d7-40a8-8a2f-6582bdf904e4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-818727048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163e4f83cf6c496daaefcf07f2458334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb2255d-47", "ovs_interfaceid": "dbb2255d-474a-4c91-b153-077161406df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG os_vif [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb2255d-47, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:02:24 user nova-compute[72793]: INFO os_vif [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=dbb2255d-474a-4c91-b153-077161406df7,network=Network(6ca2c535-79d7-40a8-8a2f-6582bdf904e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb2255d-47')
Aug 17 04:02:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Deleting instance files /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a_del
Aug 17 04:02:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Deletion of /opt/stack/data/nova/instances/28306d00-a9c4-4395-b2db-e4b59e035f6a_del complete
Aug 17 04:02:24 user nova-compute[72793]: INFO nova.compute.manager [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 04:02:24 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:02:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:02:25 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Took 1.12 seconds to deallocate network for instance.
Aug 17 04:02:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-9930b234-cba6-43c3-8d47-e3ae4cd10953 req-45eac399-bf6c-4464-bb6e-f0fa0bc0f449 service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-vif-deleted-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-b902b1ac-b993-4895-a0f4-1c95ab6bae7e req-72ea658e-4957-4398-9158-4ec5deea0d7e service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received event network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b902b1ac-b993-4895-a0f4-1c95ab6bae7e req-72ea658e-4957-4398-9158-4ec5deea0d7e service nova] Acquiring lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b902b1ac-b993-4895-a0f4-1c95ab6bae7e req-72ea658e-4957-4398-9158-4ec5deea0d7e service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b902b1ac-b993-4895-a0f4-1c95ab6bae7e req-72ea658e-4957-4398-9158-4ec5deea0d7e service nova] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-b902b1ac-b993-4895-a0f4-1c95ab6bae7e req-72ea658e-4957-4398-9158-4ec5deea0d7e service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] No waiting events found dispatching network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:02:25 user nova-compute[72793]: WARNING nova.compute.manager [req-b902b1ac-b993-4895-a0f4-1c95ab6bae7e req-72ea658e-4957-4398-9158-4ec5deea0d7e service nova] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Received unexpected event network-vif-plugged-dbb2255d-474a-4c91-b153-077161406df7 for instance with vm_state deleted and task_state None.
Aug 17 04:02:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:26 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Deleted allocations for instance 28306d00-a9c4-4395-b2db-e4b59e035f6a
Aug 17 04:02:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-92816e46-d764-44b8-ae78-94f03be2f1ec tempest-VolumesActionsTest-2053759356 tempest-VolumesActionsTest-2053759356-project-member] Lock "28306d00-a9c4-4395-b2db-e4b59e035f6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.664s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:39 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244944.2193065, 28306d00-a9c4-4395-b2db-e4b59e035f6a => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:02:39 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] VM Stopped (Lifecycle Event)
Aug 17 04:02:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-14a1b649-1598-4e3a-b6b7-e42d84a92e31 None None] [instance: 28306d00-a9c4-4395-b2db-e4b59e035f6a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:02:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:49 user nova-compute[72793]: INFO nova.compute.manager [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Terminating instance
Aug 17 04:02:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2ee33f1-2925-4a8d-a1d2-62c1692a5163 req-75599179-2562-4465-8bdc-760775a8046c service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-unplugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2ee33f1-2925-4a8d-a1d2-62c1692a5163 req-75599179-2562-4465-8bdc-760775a8046c service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2ee33f1-2925-4a8d-a1d2-62c1692a5163 req-75599179-2562-4465-8bdc-760775a8046c service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2ee33f1-2925-4a8d-a1d2-62c1692a5163 req-75599179-2562-4465-8bdc-760775a8046c service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2ee33f1-2925-4a8d-a1d2-62c1692a5163 req-75599179-2562-4465-8bdc-760775a8046c service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-unplugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:02:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2ee33f1-2925-4a8d-a1d2-62c1692a5163 req-75599179-2562-4465-8bdc-760775a8046c service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-unplugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:02:50 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Instance destroyed successfully.
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.objects.instance [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lazy-loading 'resources' on Instance uuid 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T03:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-924638203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-917225422',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDlQJCI7rjvlO55Em8P3/L29qbMQcM7TGvwcHeUUvSNLXuhg3UnhsGj5W2Id2HCnfxiEhL7JNP5OzbDmWKx6l92PP088myRaT0v0OING/Z0OZwctCgd6AjAXMkWxDRTog==',key_name='tempest-keypair-2019873661',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='509f87a040314d60ab44619f429bf643',ramdisk_id='',reservation_id='r-itn0ol3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-696729334',owner_user_name='tempest-ServerActionsV293TestJSON-696729334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8cc25ca429a24dd69d17c141308f8b33',uuid=31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converting VIF {"id": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "address": "fa:16:3e:bc:f0:05", "network": {"id": "4bc4365c-db61-4285-8881-b8754fe02455", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1329270391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509f87a040314d60ab44619f429bf643", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07c47f54-74", "ovs_interfaceid": "07c47f54-74de-4003-bdcd-73f85b27f1e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_vif [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07c47f54-74, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:50 user nova-compute[72793]: INFO os_vif [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=07c47f54-74de-4003-bdcd-73f85b27f1e5,network=Network(4bc4365c-db61-4285-8881-b8754fe02455),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07c47f54-74')
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJhGRykp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:02:50 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb2fc9-577e-4142-bcce-eec903a62e69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02d70e7-0155-4bd2-a26a-020b6c176673]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:02:50 user nova-compute[72793]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:02:50 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 (non-flash)
Aug 17 04:02:50 user nova-compute[72793]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:02:50 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02bef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187'): ({'sdd'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Removing single pathed devices sdd {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[58764ca3-a0c6-4a5b-b3dc-6350fc8b53ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8bc2e9-5c99-4aca-ab49-48c3b1083822]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Flushing IO for device /dev/sdd {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d66d3-58f7-4519-9b88-7cf07ff757bb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a18889-c2e2-42e4-b961-0835f2826b7e]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_df844da9', '/dev/disk/by-id/scsi-1SCST_BIOdf844da9-589b7001b9e2bb32', '/dev/disk/by-id/scsi-23538396237303031') {{(pid=84011) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[54acd016-4031-4d7c-8f27-53fb1e9e4e71]: (4, None) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a64c5-814c-49d2-b4ce-f72a151445d4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ba252c-8c8f-4cf5-ace4-c58e53047397]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260]
Aug 17 04:02:50 user nova-compute[72793]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187, portal: 172.16.0.220,3260] successful.
Aug 17 04:02:50 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2a859f4-3d7c-40d9-a818-e709fd9cf187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedd99d1-0341-4ac7-ba41-5363226a2bac]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] <== disconnect_volume: return (303ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:02:50 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Deleting instance files /opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13_del
Aug 17 04:02:50 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Deletion of /opt/stack/data/nova/instances/31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13_del complete
Aug 17 04:02:50 user nova-compute[72793]: INFO nova.compute.manager [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 17 04:02:50 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:02:50 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:02:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-c35e845c-fe35-42f2-9165-eddc5e0e018c req-40b934db-560d-47e5-af04-26a2459cdff8 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c35e845c-fe35-42f2-9165-eddc5e0e018c req-40b934db-560d-47e5-af04-26a2459cdff8 service nova] Acquiring lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c35e845c-fe35-42f2-9165-eddc5e0e018c req-40b934db-560d-47e5-af04-26a2459cdff8 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c35e845c-fe35-42f2-9165-eddc5e0e018c req-40b934db-560d-47e5-af04-26a2459cdff8 service nova] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-c35e845c-fe35-42f2-9165-eddc5e0e018c req-40b934db-560d-47e5-af04-26a2459cdff8 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] No waiting events found dispatching network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:02:52 user nova-compute[72793]: WARNING nova.compute.manager [req-c35e845c-fe35-42f2-9165-eddc5e0e018c req-40b934db-560d-47e5-af04-26a2459cdff8 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received unexpected event network-vif-plugged-07c47f54-74de-4003-bdcd-73f85b27f1e5 for instance with vm_state active and task_state deleting.
Aug 17 04:02:52 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:02:52 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Took 1.72 seconds to deallocate network for instance.
Aug 17 04:02:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-9114b4b8-0409-4a1f-aa12-3249a933d48e req-4d3cf7f0-2be1-40e1-a836-d0605efa4ae4 service nova] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Received event network-vif-deleted-07c47f54-74de-4003-bdcd-73f85b27f1e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:02:54 user nova-compute[72793]: INFO nova.compute.manager [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Took 2.17 seconds to detach 1 volumes for instance.
Aug 17 04:02:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Deleting volume: d2a859f4-3d7c-40d9-a818-e709fd9cf187 {{(pid=72793) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 04:02:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:55 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:02:55 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:02:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:55 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Deleted allocations for instance 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13
Aug 17 04:02:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10a7e76d-e3b1-46f1-be2c-40da09fd0ddf tempest-ServerActionsV293TestJSON-696729334 tempest-ServerActionsV293TestJSON-696729334-project-member] Lock "31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.851s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:02:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:02:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:02:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:58 user nova-compute[72793]: DEBUG nova.objects.instance [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'flavor' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:02:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:02:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:02:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:02:58 user nova-compute[72793]: INFO nova.compute.manager [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Attaching volume 5b1915cc-f648-4e44-9bd2-e3cea7728bbf to /dev/vdb
Aug 17 04:02:59 user nova-compute[72793]: DEBUG os_brick.utils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3ba714-ad6a-4c6d-b430-27007506502d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f9187e-a2be-4f04-993a-e4c2c78f56ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6753079-9a8a-433c-a24b-592dd56af99b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eb0f39-b09e-4db7-b6a3-da33c3530573]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:02:59 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:02:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f4681-09ff-4a36-93b2-56bf44ab8325]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG os_brick.utils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating existing volume attachment record: aa05e8a3-1f0d-4247-8655-69655361242b {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:02:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:03 user nova-compute[72793]: INFO nova.compute.manager [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Terminating instance
Aug 17 04:03:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-527edb06-54e1-44c6-8e26-87dd602cae96 req-916d76af-f786-460a-9728-3cfcb02f510a service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-vif-unplugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-527edb06-54e1-44c6-8e26-87dd602cae96 req-916d76af-f786-460a-9728-3cfcb02f510a service nova] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-527edb06-54e1-44c6-8e26-87dd602cae96 req-916d76af-f786-460a-9728-3cfcb02f510a service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-527edb06-54e1-44c6-8e26-87dd602cae96 req-916d76af-f786-460a-9728-3cfcb02f510a service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-527edb06-54e1-44c6-8e26-87dd602cae96 req-916d76af-f786-460a-9728-3cfcb02f510a service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] No waiting events found dispatching network-vif-unplugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-527edb06-54e1-44c6-8e26-87dd602cae96 req-916d76af-f786-460a-9728-3cfcb02f510a service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-vif-unplugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Instance destroyed successfully.
Aug 17 04:03:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'resources' on Instance uuid 84cf389f-3a35-4e65-a7c9-7eb679c48df1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1038281009',display_name='tempest-VolumesAdminNegativeTest-server-1038281009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1038281009',id=14,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584b479f01844391a15d9b00afc60453',ramdisk_id='',reservation_id='r-bwqi8362',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-540254454',owner_user_name='tempest-VolumesAdminNegativeTest-540254454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:01:10Z,user_data=None,user_id='82e025f0dc8745b3bf13231832816033',uuid=84cf389f-3a35-4e65-a7c9-7eb679c48df1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converting VIF {"id": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "address": "fa:16:3e:bf:77:3d", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a04f4d5-7d", "ovs_interfaceid": "7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG os_vif [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a04f4d5-7d, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:04 user nova-compute[72793]: INFO os_vif [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:77:3d,bridge_name='br-int',has_traffic_filtering=True,id=7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a04f4d5-7d')
Aug 17 04:03:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Deleting instance files /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1_del
Aug 17 04:03:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Deletion of /opt/stack/data/nova/instances/84cf389f-3a35-4e65-a7c9-7eb679c48df1_del complete
Aug 17 04:03:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:04 user nova-compute[72793]: INFO nova.compute.manager [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 17 04:03:04 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:03:04 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7302MB free_disk=25.668228149414062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Applying migration context for instance 07328c90-993b-4b0c-8673-04c850aae29c as it has an incoming, in-progress migration ae6bc42d-08e4-4896-99de-5639f2272b63. Migration status is finished {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 04:03:05 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating resource usage from migration ae6bc42d-08e4-4896-99de-5639f2272b63
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 245698d6-2693-404a-b365-e17fc5665259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 84cf389f-3a35-4e65-a7c9-7eb679c48df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Migration ae6bc42d-08e4-4896-99de-5639f2272b63 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244970.3568957, 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:05 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] VM Stopped (Lifecycle Event)
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a4d7566a-abec-443e-be57-e95b8d82f1b9 None None] [instance: 31ffa60c-5b8c-4cdb-a9da-8c1e880d5a13] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-changed-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Refreshing instance network info cache due to event network-changed-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] Acquiring lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] Acquired lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Refreshing network info cache for port 4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:03:05 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-42da0560-ab57-4529-9194-38cbaa607190 req-3bb07350-5165-4d7c-a524-b398f68d028f service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-42da0560-ab57-4529-9194-38cbaa607190 req-3bb07350-5165-4d7c-a524-b398f68d028f service nova] Acquiring lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-42da0560-ab57-4529-9194-38cbaa607190 req-3bb07350-5165-4d7c-a524-b398f68d028f service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-42da0560-ab57-4529-9194-38cbaa607190 req-3bb07350-5165-4d7c-a524-b398f68d028f service nova] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-42da0560-ab57-4529-9194-38cbaa607190 req-3bb07350-5165-4d7c-a524-b398f68d028f service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] No waiting events found dispatching network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:06 user nova-compute[72793]: WARNING nova.compute.manager [req-42da0560-ab57-4529-9194-38cbaa607190 req-3bb07350-5165-4d7c-a524-b398f68d028f service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received unexpected event network-vif-plugged-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc for instance with vm_state active and task_state deleting.
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.956s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.815s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:03:06 user nova-compute[72793]: INFO nova.compute.claims [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Claim successful on node user
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:06 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Took 1.49 seconds to deallocate network for instance.
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'flavor' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updated VIF entry in instance network info cache for port 4d8d064e-ed85-494d-a8aa-c53b4f37ecfa. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating instance_info_cache with network_info: [{"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d8dd7b15-de05-4742-8c05-d304d8da3bd8 req-16de9bda-fa13-40fd-bfeb-124d73226d45 service nova] Releasing lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.463s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:06 user nova-compute[72793]: INFO nova.compute.manager [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attaching volume 908b6760-985b-4839-ad93-9e0f44af5afd to /dev/vdb
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:03:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.utils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd72c6a2-3b49-47fd-a882-002da0272285]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4983f6-2a56-449f-808a-4c26a4413648]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad44a67-c7f2-4090-bc25-f521834164a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a479c12-dc22-496c-9646-47546b683162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:06 user nova-compute[72793]: INFO nova.virt.block_device [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Booting with volume 49dc4f36-f4bf-4008-995f-7b0f1c9c755d at /dev/vda
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:06 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f0f8db-8ea5-4536-9668-bacf858d8b23]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.utils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating existing volume attachment record: 33e9c301-210f-4379-947b-45ed5d134452 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG nova.policy [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '228663705d3d4379984c1e0ce148ee96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116148bcb3af453983d87c6e9275d92c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG os_brick.utils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[659fefda-8ba3-42f0-b369-449cba421f9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5281b9e-2340-469c-9a2f-162dced95012]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd4583-a0bb-4087-a10d-c50fb4439f43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9ed8d-4dee-45e0-baa9-9dcba2fe59fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:07 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3255d7e-ab2b-42f4-9ba5-13ab015fc253]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG os_brick.utils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating existing volume attachment record: 010548c7-a14e-4c2f-ba47-75637a73c287 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.709s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:07 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Deleted allocations for instance 84cf389f-3a35-4e65-a7c9-7eb679c48df1
Aug 17 04:03:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4a3f561d-07b5-479a-a0f7-b4d05612bee6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "84cf389f-3a35-4e65-a7c9-7eb679c48df1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.977s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully created port: c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:03:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-d203d8cf-1318-415e-a85c-8eac22506b4e req-6db5c736-8559-4ce8-8283-57364f5f621b service nova] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Received event network-vif-deleted-7a04f4d5-7d2d-436e-8f89-dd5fc431c7cc {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully created port: 2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:03:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:03:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:03:09 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully created port: 98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:03:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:09 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully created port: 6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:03:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Port fcf0e2da-57d4-4b11-8d5d-4410979612d7 binding to destination host user is already ACTIVE {{(pid=72793) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 04:03:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:03:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully created port: b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Creating tmpfile /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/tmpicwspthp to verify with other compute node that the instance is on the same shared storage. {{(pid=72793) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-83d2299b-c37b-4bf8-8795-d8de9767f408 req-90399d37-22a1-48d9-80dc-1c7e49fef21a service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-83d2299b-c37b-4bf8-8795-d8de9767f408 req-90399d37-22a1-48d9-80dc-1c7e49fef21a service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-83d2299b-c37b-4bf8-8795-d8de9767f408 req-90399d37-22a1-48d9-80dc-1c7e49fef21a service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-83d2299b-c37b-4bf8-8795-d8de9767f408 req-90399d37-22a1-48d9-80dc-1c7e49fef21a service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-83d2299b-c37b-4bf8-8795-d8de9767f408 req-90399d37-22a1-48d9-80dc-1c7e49fef21a service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:11 user nova-compute[72793]: WARNING nova.compute.manager [req-83d2299b-c37b-4bf8-8795-d8de9767f408 req-90399d37-22a1-48d9-80dc-1c7e49fef21a service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance destroyed successfully.
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'resources' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf0e2da-57, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:12 user nova-compute[72793]: INFO os_vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57')
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:12 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-c2671b4e-a6e4-46d2-88f8-6441507b41b5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.network.neutron [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f944f8-c4cf-4c68-9be9-1ad03ff46754]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd5b7f0-918b-4522-9df4-adfbd19be59e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d079d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeb81f3-e65d-4c8d-bc8a-54fe325dbec1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.network.neutron [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabec148-f112-4b18-8c14-405cf84f4041]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309fd3d-37c6-47e6-8801-3f56cee20feb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2a418-1f44-439b-a491-8fee8d864ea1]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827d363-9593-4b43-b43f-f4c7e939c9de]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[56394aad-a1b2-4cc5-895a-88a8a697b94f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]
Aug 17 04:03:12 user nova-compute[72793]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67d953d-95e0-412e-bd38-5d6ea52e1673]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== disconnect_volume: return (380ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG nova.network.neutron [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a1905d85-ff52-47ae-8369-9d65dda45159 req-a7eab16b-626a-4bec-9985-5bacd2dcdc0c service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: 831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:13 user nova-compute[72793]: WARNING nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:13 user nova-compute[72793]: WARNING nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:13 user nova-compute[72793]: WARNING nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:13 user nova-compute[72793]: WARNING nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:13 user nova-compute[72793]: WARNING nova.compute.manager [req-0ad0da37-1231-4d03-a1fe-88fa80a505dd req-47cd521e-9fae-46a4-8d4f-ca1c57c3c519 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: 59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-831eb634-f3a3-4e63-89e5-54b481de69e7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port 831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-59341503-9546-4ede-810c-a4e75084eeb6. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port 59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: 2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:15 user nova-compute[72793]: DEBUG nova.network.neutron [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-916825a7-5699-4666-a947-475db833f24d req-8f3a9185-86aa-460c-889a-bd132bf29b36 service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: 98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port 2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-98580878-b000-4d2f-a896-7e2470e9af62. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port 98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: 6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:17 user nova-compute[72793]: DEBUG nova.network.neutron [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-21e0707c-0a35-4d69-9b00-7e645b1c4182 req-af65e541-9dfe-40c9-8b54-e48c1ae11eb6 service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Successfully updated port: b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-6b615dba-5e5b-4ef9-9110-b1babcb22539. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:19 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:19 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:19 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244984.394518, 84cf389f-3a35-4e65-a7c9-7eb679c48df1 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:19 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] VM Stopped (Lifecycle Event)
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0646c-c10e-404f-8221-8dcae898e1d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:03:19 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2a01e565-50ba-4145-87df-958d659e9191 None None] [instance: 84cf389f-3a35-4e65-a7c9-7eb679c48df1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7383bd28-a165-45f4-9550-720332516732]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd] added
Aug 17 04:03:19 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6bd1aa-b8fa-42d3-9e9b-78ea1bcf62af]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dc7cc3-f574-4fa5-9e2a-c16ff1bf2d96]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfvHXxRq {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfvHXxRq" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd03ca83-cdec-4368-aebb-68aaa8c33caa]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfvHXxRq'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b4970d-3f57-4c28-9c6c-4df3c43cbf29]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce2652-ca6a-4936-8ba3-4a820d615dd3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:03:19 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:03:19 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:19 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:03:19 user nova-compute[72793]: 
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[079d5932-ef8c-4348-b6b6-53d6acf0ebe4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]
Aug 17 04:03:19 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:19 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c987b82-2aa5-4356-86ca-8902fdbdc906]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a220fc41-9197-4fec-b3b0-49aca4ec5aca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:19 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:19 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a0491-417e-46fa-83b7-9a88d21b8a26]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:03:19 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:03:19 user nova-compute[72793]: INFO nova.virt.block_device [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Booting with volume fa192701-fc9e-4df7-b12c-e0434337a230 at /dev/vdb
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.utils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20077a4-2628-4f86-b0c9-e3aeceef4789]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f086da-98c6-43da-9deb-24f8357c0670]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e12342b-a458-4c00-8393-30308da76ec4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8097c4a1-9cc3-4092-8ec3-a9d3281f52ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:20 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab876584-bafb-47d7-8b50-8175aa4bd75b]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.utils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating existing volume attachment record: faf460f5-4185-45b3-a439-48a2061e5aec {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23237383536373463', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237383536373463', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'flavor' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:03:20 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:20 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:03:20 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:03:20 user nova-compute[72793]:   <serial>908b6760-985b-4839-ad93-9e0f44af5afd</serial>
Aug 17 04:03:20 user nova-compute[72793]: </disk>
Aug 17 04:03:20 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'migration_context' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No VIF found with MAC fa:16:3e:a9:49:e1, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance network_info: |[{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port 6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.569s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3f604193-c660-468a-9ec4-7ea972887297 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.955s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:21 user nova-compute[72793]: INFO nova.compute.manager [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Swapping old allocation on dict_keys(['ef0e298c-f5d0-48e3-afdd-0063943a3710']) held by migration ae6bc42d-08e4-4896-99de-5639f2272b63 for instance
Aug 17 04:03:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Overwriting current allocation {'allocations': {'ef0e298c-f5d0-48e3-afdd-0063943a3710': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '5b799dd936be46aab2513974c488ae92', 'user_id': 'ad95533bd5634f7384f9c9f58a9aaf81', 'consumer_generation': 1} on consumer 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquired lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updated VIF entry in instance network info cache for port 6b615dba-5e5b-4ef9-9110-b1babcb22539. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-b92bfd5c-f326-47d3-b825-af2d680b8078. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Releasing lock "refresh_cache-07328c90-993b-4b0c-8673-04c850aae29c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG os_brick.utils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405dd27-0fa7-4544-8b2c-894e3ecfe3fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb3811-1d0e-491f-a781-8d3b9358781d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updated VIF entry in instance network info cache for port b92bfd5c-f326-47d3-b825-af2d680b8078. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d17ec-1d6e-461b-8ebc-de0491fe90f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d101714-1a14-467a-bf0f-236c45479c78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4e0cc2b-96de-43b3-ada7-26948c10bbec req-64ab71ab-7ec9-4f8b-9a68-244f7319e63b service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:22 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaa0acb-ee20-4da7-a743-00321fb5105a]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:22 user nova-compute[72793]: DEBUG os_brick.utils [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:23 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:23 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:23 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bb9c0f-03d7-40a3-a3a5-c3225439a819]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:03:23 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa52271-0859-4177-94b9-43aea2a1dcbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf] added
Aug 17 04:03:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1cf726-c130-47be-8c38-48a3efec1f2f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb27f7-ae9c-4943-a8e0-b136bf5163a3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifnymzru {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifnymzru" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[744b91b2-ddf6-47f1-a397-54dde65c2497]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ifnymzru'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[09239eab-0513-4e0b-801e-fda78e360c4a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707f308-906a-4ecd-b93c-87bd1ba10e9a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0256c99d-c11f-416d-9711-740de365b43d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]
Aug 17 04:03:24 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[21638598-21b7-4df2-a5e1-ad0f4b742ddd]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2f7282-d033-4847-841d-01dc4683f51b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:24 user nova-compute[72793]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:24 user nova-compute[72793]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd167aa-f746-4a1f-8c9a-fc465155891a]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:03:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23861346530653662', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861346530653662', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'flavor' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:03:25 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:25 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:03:25 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:03:25 user nova-compute[72793]:   <serial>5b1915cc-f648-4e44-9bd2-e3cea7728bbf</serial>
Aug 17 04:03:25 user nova-compute[72793]: </disk>
Aug 17 04:03:25 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:03:25 user nova-compute[72793]: INFO nova.compute.manager [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Rebuilding instance
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'trusted_certs' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_requests' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_devices' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'resources' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'migration_context' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72793) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No VIF found with MAC fa:16:3e:1e:f6:ad, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-52468e5b-c356-44be-bb80-905dbcbf6047 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.983s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-2b9fea51-60cd-4d81-8f55-676debfa4330 req-603c4d2b-96a1-463e-a7d9-7b91ef86ef2b service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-unplugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2b9fea51-60cd-4d81-8f55-676debfa4330 req-603c4d2b-96a1-463e-a7d9-7b91ef86ef2b service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2b9fea51-60cd-4d81-8f55-676debfa4330 req-603c4d2b-96a1-463e-a7d9-7b91ef86ef2b service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2b9fea51-60cd-4d81-8f55-676debfa4330 req-603c4d2b-96a1-463e-a7d9-7b91ef86ef2b service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-2b9fea51-60cd-4d81-8f55-676debfa4330 req-603c4d2b-96a1-463e-a7d9-7b91ef86ef2b service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-unplugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:26 user nova-compute[72793]: WARNING nova.compute.manager [req-2b9fea51-60cd-4d81-8f55-676debfa4330 req-603c4d2b-96a1-463e-a7d9-7b91ef86ef2b service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-unplugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state active and task_state rebuilding.
Aug 17 04:03:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance destroyed successfully.
Aug 17 04:03:27 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692244992.0533326, 07328c90-993b-4b0c-8673-04c850aae29c => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:27 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Stopped (Lifecycle Event)
Aug 17 04:03:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-848d1049-d239-40a5-ad3e-a37536467223 None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:27 user nova-compute[72793]: INFO nova.compute.manager [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Detaching volume 908b6760-985b-4839-ad93-9e0f44af5afd
Aug 17 04:03:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:27 user nova-compute[72793]: INFO nova.virt.block_device [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attempting to driver detach volume 908b6760-985b-4839-ad93-9e0f44af5afd from mountpoint /dev/vdb
Aug 17 04:03:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Attempting to detach device vdb from instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:03:27 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:27 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:03:27 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:03:27 user nova-compute[72793]:   <serial>908b6760-985b-4839-ad93-9e0f44af5afd</serial>
Aug 17 04:03:27 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:03:27 user nova-compute[72793]: </disk>
Aug 17 04:03:27 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:03:27 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully detached device vdb from instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a from the persistent domain config.
Aug 17 04:03:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:27 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cba8a7-7921-4e92-b194-a8d39f7eb7a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6367f146-e910-42af-80c6-9dfb15a64d02]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:27 user nova-compute[72793]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:03:27 user nova-compute[72793]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d051edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fc06f5-e83f-4611-828d-d43433f759b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce191b0-9551-4b70-971c-90c98e2569ce]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6006b10-0f22-4ffa-a958-450e049676b3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b2a1e0-7a68-4541-b13b-2a54ec1cce66]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386b71d-3398-43ec-90bc-5188f8c1c65a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88c41a5-9a00-4a6d-9bfe-b5e66d189192]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]
Aug 17 04:03:27 user nova-compute[72793]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00110f-e928-4433-9bbf-0402f5e683f4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== disconnect_volume: return (346ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:03:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-4c92790f-17b7-4efd-bac7-1cbcaf2da765 req-30be7eb0-93fb-448b-b380-6890c34a93c8 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4c92790f-17b7-4efd-bac7-1cbcaf2da765 req-30be7eb0-93fb-448b-b380-6890c34a93c8 service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4c92790f-17b7-4efd-bac7-1cbcaf2da765 req-30be7eb0-93fb-448b-b380-6890c34a93c8 service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4c92790f-17b7-4efd-bac7-1cbcaf2da765 req-30be7eb0-93fb-448b-b380-6890c34a93c8 service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-4c92790f-17b7-4efd-bac7-1cbcaf2da765 req-30be7eb0-93fb-448b-b380-6890c34a93c8 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:28 user nova-compute[72793]: WARNING nova.compute.manager [req-4c92790f-17b7-4efd-bac7-1cbcaf2da765 req-30be7eb0-93fb-448b-b380-6890c34a93c8 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state active and task_state rebuilding.
Aug 17 04:03:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:29 user nova-compute[72793]: INFO nova.compute.manager [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] instance snapshotting
Aug 17 04:03:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Beginning live snapshot process
Aug 17 04:03:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvyo560n4/00a51ac64a4849dd91b772b09a916b48.delta 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvyo560n4/00a51ac64a4849dd91b772b09a916b48.delta 1073741824" returned: 0 in 0.065s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 04:03:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:03:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:03:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 04:03:31 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:03:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvyo560n4/00a51ac64a4849dd91b772b09a916b48.delta /opt/stack/data/nova/instances/snapshots/tmpvyo560n4/00a51ac64a4849dd91b772b09a916b48 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvyo560n4/00a51ac64a4849dd91b772b09a916b48.delta /opt/stack/data/nova/instances/snapshots/tmpvyo560n4/00a51ac64a4849dd91b772b09a916b48" returned: 0 in 0.854s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Snapshot extracted, beginning image upload
Aug 17 04:03:33 user nova-compute[72793]: INFO nova.virt.block_device [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Booting with volume a96f7082-5584-4d3e-8cde-5e01383748eb at /dev/vdc
Aug 17 04:03:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d7f96a-8be2-4edf-9cc8-044c417f303a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d52eadd-24c7-4158-a22e-65b7eb02515a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbd4e63-e731-4774-8e0e-be4071a8fd1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[331f8c1f-ada5-4c89-8b86-7fb84c4ea90c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:34 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[15627ca0-c3e0-4380-870a-a3b7b9b8ce35]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:34 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating existing volume attachment record: 6e75e950-d108-4be4-9335-6e352785e991 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:03:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Snapshot image upload complete
Aug 17 04:03:36 user nova-compute[72793]: INFO nova.compute.manager [None req-f838a095-2cc9-4b36-840a-8f3252dc8b3e tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Took 6.51 seconds to snapshot the instance on the hypervisor.
Aug 17 04:03:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:41 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245006.4618483, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:41 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] VM Stopped (Lifecycle Event)
Aug 17 04:03:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3e38f840-9aed-4253-8eb5-5f391abe06e1 None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3e38f840-9aed-4253-8eb5-5f391abe06e1 None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuilding, current DB power_state: 1, VM power_state: 4 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:03:41 user nova-compute[72793]: INFO nova.compute.manager [None req-3e38f840-9aed-4253-8eb5-5f391abe06e1 None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] During sync_power_state the instance has a pending task (rebuilding). Skip.
Aug 17 04:03:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:03:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:43 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:03:43 user nova-compute[72793]: INFO nova.compute.claims [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Claim successful on node user
Aug 17 04:03:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:44 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:03:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:03:44 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:03:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.297s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:03:45 user nova-compute[72793]: WARNING nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] While synchronizing instance power states, found 9 instances in the database and 6 instances on the hypervisor.
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 210d0b74-53d8-45d4-b4b4-691c18fc125b {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid dd0181a5-64af-4df2-854e-4703c76fd6e7 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "07328c90-993b-4b0c-8673-04c850aae29c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: INFO nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "07328c90-993b-4b0c-8673-04c850aae29c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "62329071-aa56-4d72-9053-e84606823cd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: INFO nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] During sync_power_state the instance has a pending task (rebuilding). Skip.
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "62329071-aa56-4d72-9053-e84606823cd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.245s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.246s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.239s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.243s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.293s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:03:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:03:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:03:46 user nova-compute[72793]: DEBUG nova.policy [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1420f8967734176ac04ac8b1e2646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916dfd267de46389faa83f4947db86f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:03:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:03:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-changed-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Refreshing instance network info cache due to event network-changed-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] Acquiring lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] Acquired lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:46 user nova-compute[72793]: DEBUG nova.network.neutron [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Refreshing network info cache for port e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updated VIF entry in instance network info cache for port e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updating instance_info_cache with network_info: [{"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:03:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Creating image(s)
Aug 17 04:03:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.052s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-29398945-a862-421f-9f26-a5ec46d86ba2 req-6ddbdfe9-5699-4daa-8f49-254b842f9ae6 service nova] Releasing lock "refresh_cache-bc92c36f-acd0-417c-b8fd-8be00f5daa3c" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:47 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Successfully created port: 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.350s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'flavor' on Instance uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:48 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Ignoring supplied device name: /dev/vdb
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:03:48 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Creating image(s)
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Ensure instance console log exists: /opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Start _get_guest_xml network_info=[{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwRuxdlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd0181a5-64af-4df2-854e-4703c76fd6e7', 'attached_at': '', 'detached_at': '', 'volume_id': '49dc4f36-f4bf-4008-995f-7b0f1c9c755d', 'serial': '49dc4f36-f4bf-4008-995f-7b0f1c9c755d'}, 'guest_format': None, 'attachment_id': '010548c7-a14e-4c2f-ba47-75637a73c287', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzVapvOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd0181a5-64af-4df2-854e-4703c76fd6e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa192701-fc9e-4df7-b12c-e0434337a230', 'serial': 'fa192701-fc9e-4df7-b12c-e0434337a230'}, 'guest_format': None, 'attachment_id': 'faf460f5-4185-45b3-a439-48a2061e5aec', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkjtRAVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd0181a5-64af-4df2-854e-4703c76fd6e7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a96f7082-5584-4d3e-8cde-5e01383748eb', 'serial': 'a96f7082-5584-4d3e-8cde-5e01383748eb'}, 'guest_format': None, 'attachment_id': '6e75e950-d108-4be4-9335-6e352785e991', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.266s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwRuxdlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:48 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:48 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:48 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk 1073741824" returned: 0 in 0.151s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.420s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260" returned: 21 in 0.047s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[546d922c-a625-40bc-85ca-f7806a28c9a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:03:48 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d875d4a-e655-4638-aaab-0a4989e7b054]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d] added
Aug 17 04:03:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee978b9-7aba-4061-9a51-60dac66e145d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d093e-9927-4c08-a1d0-8a2c5363c2e0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwRuxdlb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwRuxdlb" returned: 0 in 0.041s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31e8638-8b79-44b3-a0ab-b991d92a7090]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rwRuxdlb'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:48 user nova-compute[72793]: INFO nova.compute.manager [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Attaching volume 743584db-d218-4613-bf09-cc2bbd95731e to /dev/vdb
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186064b-a721-4634-94ab-320967be8ec3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1cebc2-4b94-4cc0-8900-384af1033669]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:48 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:48 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:48 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Cannot resize image /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'migration_context' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1618c1c-380d-421f-8168-2e8b2eaa4b97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Starting finish_revert_migration {{(pid=72793) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Ensure instance console log exists: /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260]
Aug 17 04:03:49 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:49 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start _get_guest_xml network_info=[{"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '07328c90-993b-4b0c-8673-04c850aae29c', 'attached_at': '2023-08-17T04:03:49.000000', 'detached_at': '', 'volume_id': '8b7bb4ef-1973-40d0-994c-b13795372071', 'serial': '8b7bb4ef-1973-40d0-994c-b13795372071'}, 'guest_format': None, 'attachment_id': 'cafc0118-91ba-454b-b5ad-137ad73acef9', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:03:49 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:49 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f52e3-78ec-426f-a4a3-e5e454263084]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.utils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Successfully updated port: 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:49 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e7113-eed6-4071-98a4-59f6d2d9d7bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[012a7e1a-61e5-4b56-89a6-07a3e492f297]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing instance network info cache due to event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.neutron [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:49 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:49 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:49 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:49 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:49 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:49 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.685s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcc4be4-ebfb-4e7e-bac9-81f8668c7ed9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance destroyed successfully.
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780488707',display_name='tempest-ServerActionsTestOtherA-server-321540172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-780488707',id=15,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVutA9Tlf0owhQuLQZK0QoDbulIgKPSwUdDttRITsXkGjWxHg/0URF8DFUdn+qiNuqMEbrZXqZbm7X9YC2/nPRdYJorxhdjSfVjua8acZNIGbvmKrQsrL6l9UwIXtnvUQ==',key_name='tempest-keypair-169977143',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-d0ga5een',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=ecbd6261-7b55-4225-97c8-bbd02b37aa5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.050s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e45e913-b2dc-4ae3-9a58-0a29e8ea2150]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwRuxdlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d24014-29c5-43f0-a094-73681bfab1f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d8d064e-ed, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.neutron [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d033a439-8e72-4044-90f6-10939dc1e551]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:49 user nova-compute[72793]: INFO os_vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed')
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:49 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:49 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d5d6b0-472a-4d70-a284-ee3f7da2c350]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG os_brick.utils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== get_connector_properties: return (278ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updating existing volume attachment record: 84c40d71-54a6-45f5-a309-5e9e48b3880a {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.neutron [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-286f03f0-978f-4610-afe9-74ab73a0da16 req-10b720f0-bf8b-4f1a-a0fd-42e1970998a3 service nova] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:03:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.782s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== connect_volume: return (1784ms) {'type': 'block', 'scsi_wwn': '23365656264383332', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365656264383332', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.124s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:50 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:50 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260" returned: 21 in 0.072s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43d44a-4d83-4563-8ee2-4ef4533f6c63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:03:50 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.089s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5558316-42df-473c-a54c-8be90f9f04e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071] added
Aug 17 04:03:50 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.075s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c362f-5464-42df-a381-75a3149adcd1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance network_info: |[{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzVapvOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:50 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Start _get_guest_xml network_info=[{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.071s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37603e3-59a2-4593-b8c8-5053449afe7e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRcNjTIp {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:50 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:50 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iRcNjTIp" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83319a-580d-4587-a90e-e2dd45fe266a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iRcNjTIp'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1507473122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1507473122',id=19,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrYpNqboEd0ERFKC5NS2ZIfTQfDZHRIFefcipuw+YBUg4ZM66mkSJgdM3pq8bkcMf+QrOE0d8rVnKiHxFsp6JC+nCOfBD7Y7xqpQdS1+iE15vnQG3i002oyVkZi95XEwQ==',key_name='tempest-keypair-208159808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-ndrldmu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=0caea72b-8769-4feb-ac34-5904ba45308f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:50 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'pci_devices' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2922f5-0870-4ef9-97dd-1b8b2563bf38]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e9cced-f6ff-49ab-87e7-6949b86bb97f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:03:51 user nova-compute[72793]:   <uuid>0caea72b-8769-4feb-ac34-5904ba45308f</uuid>
Aug 17 04:03:51 user nova-compute[72793]:   <name>instance-00000013</name>
Aug 17 04:03:51 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:03:51 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:03:51 user nova-compute[72793]:   <metadata>
Aug 17 04:03:51 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:03:51 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:03:51 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1507473122</nova:name>
Aug 17 04:03:51 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:03:50</nova:creationTime>
Aug 17 04:03:51 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:03:51 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:03:51 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:03:51 user nova-compute[72793]:       <nova:owner>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:user uuid="e1420f8967734176ac04ac8b1e2646ea">tempest-AttachVolumeShelveTestJSON-266550928-project-member</nova:user>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:project uuid="f916dfd267de46389faa83f4947db86f">tempest-AttachVolumeShelveTestJSON-266550928</nova:project>
Aug 17 04:03:51 user nova-compute[72793]:       </nova:owner>
Aug 17 04:03:51 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:03:51 user nova-compute[72793]:       <nova:ports>
Aug 17 04:03:51 user nova-compute[72793]:         <nova:port uuid="1d7ebec7-8e91-448f-83b0-340f8d4f68a7">
Aug 17 04:03:51 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:03:51 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:51 user nova-compute[72793]:       </nova:ports>
Aug 17 04:03:51 user nova-compute[72793]:     </nova:instance>
Aug 17 04:03:51 user nova-compute[72793]:   </metadata>
Aug 17 04:03:51 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:03:51 user nova-compute[72793]:     <system>
Aug 17 04:03:51 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:03:51 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:03:51 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:03:51 user nova-compute[72793]:       <entry name="serial">0caea72b-8769-4feb-ac34-5904ba45308f</entry>
Aug 17 04:03:51 user nova-compute[72793]:       <entry name="uuid">0caea72b-8769-4feb-ac34-5904ba45308f</entry>
Aug 17 04:03:51 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:03:51 user nova-compute[72793]:     </system>
Aug 17 04:03:51 user nova-compute[72793]:   </sysinfo>
Aug 17 04:03:51 user nova-compute[72793]:   <os>
Aug 17 04:03:51 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:03:51 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:03:51 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:03:51 user nova-compute[72793]:   </os>
Aug 17 04:03:51 user nova-compute[72793]:   <features>
Aug 17 04:03:51 user nova-compute[72793]:     <acpi/>
Aug 17 04:03:51 user nova-compute[72793]:     <apic/>
Aug 17 04:03:51 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:03:51 user nova-compute[72793]:   </features>
Aug 17 04:03:51 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:03:51 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:03:51 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:03:51 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:03:51 user nova-compute[72793]:   </clock>
Aug 17 04:03:51 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:03:51 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:03:51 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:03:51 user nova-compute[72793]:   </cpu>
Aug 17 04:03:51 user nova-compute[72793]:   <devices>
Aug 17 04:03:51 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:03:51 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:03:51 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk"/>
Aug 17 04:03:51 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:03:51 user nova-compute[72793]:     </disk>
Aug 17 04:03:51 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:51 user nova-compute[72793]:       <mac address="fa:16:3e:f1:87:19"/>
Aug 17 04:03:51 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:51 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:51 user nova-compute[72793]:       <target dev="tap1d7ebec7-8e"/>
Aug 17 04:03:51 user nova-compute[72793]:     </interface>
Aug 17 04:03:51 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:03:51 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/console.log" append="off"/>
Aug 17 04:03:51 user nova-compute[72793]:     </serial>
Aug 17 04:03:51 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:03:51 user nova-compute[72793]:     <video>
Aug 17 04:03:51 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:51 user nova-compute[72793]:     </video>
Aug 17 04:03:51 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:03:51 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:03:51 user nova-compute[72793]:     </rng>
Aug 17 04:03:51 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:03:51 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:03:51 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:03:51 user nova-compute[72793]:     </memballoon>
Aug 17 04:03:51 user nova-compute[72793]:   </devices>
Aug 17 04:03:51 user nova-compute[72793]: </domain>
Aug 17 04:03:51 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1507473122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1507473122',id=19,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrYpNqboEd0ERFKC5NS2ZIfTQfDZHRIFefcipuw+YBUg4ZM66mkSJgdM3pq8bkcMf+QrOE0d8rVnKiHxFsp6JC+nCOfBD7Y7xqpQdS1+iE15vnQG3i002oyVkZi95XEwQ==',key_name='tempest-keypair-208159808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-ndrldmu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=0caea72b-8769-4feb-ac34-5904ba45308f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_vif [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d7ebec7-8e, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d7ebec7-8e, col_values=(('external_ids', {'iface-id': '1d7ebec7-8e91-448f-83b0-340f8d4f68a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:87:19', 'vm-uuid': '0caea72b-8769-4feb-ac34-5904ba45308f'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[94500b25-b820-4ada-9b5b-bd127be08629]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]
Aug 17 04:03:51 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:51 user nova-compute[72793]: INFO os_vif [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e')
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.074s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43133cf-6f5c-448f-911e-7d5a2ba70b84]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f301b-e788-4542-8174-c456508702ba]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:51 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:51 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.928s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45069a-b60e-46a2-9771-4df5d2429839]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No VIF found with MAC fa:16:3e:f1:87:19, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.959s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== connect_volume: return (3084ms) {'type': 'block', 'scsi_wwn': '23735616166313239', 'path': '/dev/sde'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735616166313239', 'path': '/dev/sde'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.885s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7255b24c-0f93-4e56-8c63-f015a4e12846]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:03:52 user nova-compute[72793]:   <uuid>07328c90-993b-4b0c-8673-04c850aae29c</uuid>
Aug 17 04:03:52 user nova-compute[72793]:   <name>instance-00000002</name>
Aug 17 04:03:52 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:03:52 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:03:52 user nova-compute[72793]:   <metadata>
Aug 17 04:03:52 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:03:52 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:03:52 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherB-server-276616593</nova:name>
Aug 17 04:03:52 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:03:49</nova:creationTime>
Aug 17 04:03:52 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:03:52 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:03:52 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:03:52 user nova-compute[72793]:       <nova:owner>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:user uuid="ad95533bd5634f7384f9c9f58a9aaf81">tempest-ServerActionsTestOtherB-1791175768-project-member</nova:user>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:project uuid="5b799dd936be46aab2513974c488ae92">tempest-ServerActionsTestOtherB-1791175768</nova:project>
Aug 17 04:03:52 user nova-compute[72793]:       </nova:owner>
Aug 17 04:03:52 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:03:52 user nova-compute[72793]:       <nova:ports>
Aug 17 04:03:52 user nova-compute[72793]:         <nova:port uuid="fcf0e2da-57d4-4b11-8d5d-4410979612d7">
Aug 17 04:03:52 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:03:52 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:52 user nova-compute[72793]:       </nova:ports>
Aug 17 04:03:52 user nova-compute[72793]:     </nova:instance>
Aug 17 04:03:52 user nova-compute[72793]:   </metadata>
Aug 17 04:03:52 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:03:52 user nova-compute[72793]:     <system>
Aug 17 04:03:52 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:03:52 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:03:52 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:03:52 user nova-compute[72793]:       <entry name="serial">07328c90-993b-4b0c-8673-04c850aae29c</entry>
Aug 17 04:03:52 user nova-compute[72793]:       <entry name="uuid">07328c90-993b-4b0c-8673-04c850aae29c</entry>
Aug 17 04:03:52 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:03:52 user nova-compute[72793]:     </system>
Aug 17 04:03:52 user nova-compute[72793]:   </sysinfo>
Aug 17 04:03:52 user nova-compute[72793]:   <os>
Aug 17 04:03:52 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:03:52 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:03:52 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:03:52 user nova-compute[72793]:   </os>
Aug 17 04:03:52 user nova-compute[72793]:   <features>
Aug 17 04:03:52 user nova-compute[72793]:     <acpi/>
Aug 17 04:03:52 user nova-compute[72793]:     <apic/>
Aug 17 04:03:52 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:03:52 user nova-compute[72793]:   </features>
Aug 17 04:03:52 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:03:52 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:03:52 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:03:52 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:03:52 user nova-compute[72793]:   </clock>
Aug 17 04:03:52 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:03:52 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:03:52 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:03:52 user nova-compute[72793]:   </cpu>
Aug 17 04:03:52 user nova-compute[72793]:   <devices>
Aug 17 04:03:52 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:03:52 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:03:52 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk"/>
Aug 17 04:03:52 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:03:52 user nova-compute[72793]:     </disk>
Aug 17 04:03:52 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:03:52 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:52 user nova-compute[72793]:       <source dev="/dev/sde"/>
Aug 17 04:03:52 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:03:52 user nova-compute[72793]:       <serial>8b7bb4ef-1973-40d0-994c-b13795372071</serial>
Aug 17 04:03:52 user nova-compute[72793]:     </disk>
Aug 17 04:03:52 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:52 user nova-compute[72793]:       <mac address="fa:16:3e:73:21:bf"/>
Aug 17 04:03:52 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:52 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:52 user nova-compute[72793]:       <target dev="tapfcf0e2da-57"/>
Aug 17 04:03:52 user nova-compute[72793]:     </interface>
Aug 17 04:03:52 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:03:52 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/console.log" append="off"/>
Aug 17 04:03:52 user nova-compute[72793]:     </serial>
Aug 17 04:03:52 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:03:52 user nova-compute[72793]:     <video>
Aug 17 04:03:52 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:52 user nova-compute[72793]:     </video>
Aug 17 04:03:52 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:03:52 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:03:52 user nova-compute[72793]:     </rng>
Aug 17 04:03:52 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:03:52 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:03:52 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:03:52 user nova-compute[72793]:     </memballoon>
Aug 17 04:03:52 user nova-compute[72793]:   </devices>
Aug 17 04:03:52 user nova-compute[72793]: </domain>
Aug 17 04:03:52 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:03:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf0e2da-57, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcf0e2da-57, col_values=(('external_ids', {'iface-id': 'fcf0e2da-57d4-4b11-8d5d-4410979612d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:21:bf', 'vm-uuid': '07328c90-993b-4b0c-8673-04c850aae29c'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a5f8d-d234-4721-aa15-f9aa266e3542]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02f5750>, {}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Disconnecting from: [] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== disconnect_volume: return (2948ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:03:52 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Deleting instance files /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a_del
Aug 17 04:03:52 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Deletion of /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a_del complete
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.691s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:52 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:52 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:03:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:52 user nova-compute[72793]: INFO os_vif [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57')
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f076ad1-f707-4a8a-839a-44d67246f955]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:03:52 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddf551d-3e29-4541-9c10-05f5b3cc62ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230] added
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a2e34-1b40-402b-a6be-b79218e38742]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f35417-8c02-457d-932b-2e844c851373]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzVapvOY {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzVapvOY" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1776fadf-7fc7-4756-ad8b-49f16363e1f2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzVapvOY'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: INFO nova.virt.block_device [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Booting with volume 908b6760-985b-4839-ad93-9e0f44af5afd at /dev/vdb
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db23ff-19bf-402c-8d59-a6a4abf36cca]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7fdbb0-5124-4afd-ad67-e90877f59274]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.utils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[274dd8b3-636e-4cb9-98c9-218f8cbbb6dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6a21e-43e0-42dc-b8f8-9e5e7461bfbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260]
Aug 17 04:03:52 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.056s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9166aa-9cf8-48cd-a2df-f211a0fd2c7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.092s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[817b95da-42b6-4a8a-934b-bf871aa44f19]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8443737-dcba-49b3-8b6d-4d4d858319f0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:03:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.509s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.058s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b3a1e8-79c9-431b-95a2-1e7f2e9de532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3b2d74-5574-4bb0-8585-f0a0f3b664d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:03:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:03:53 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:03:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e3ed8a-4791-4ca2-b65a-253bbc2d21ba]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG os_brick.utils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== get_connector_properties: return (323ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating existing volume attachment record: 9559859f-0c13-494e-8f02-a363647f825e {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.117s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b12b11-91f7-43ca-96ba-0839a39adb3a]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzVapvOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing instance network info cache due to event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.650s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== connect_volume: return (3341ms) {'type': 'block', 'scsi_wwn': '23139643131303130', 'path': '/dev/sdf'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643131303130', 'path': '/dev/sdf'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkjtRAVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:03:54 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:54 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:03:54 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc65259-6672-4f2d-86f3-31080bb0cfb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:03:54 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7355f89-6949-4f63-a9f4-42e1264faaac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb] added
Aug 17 04:03:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updated VIF entry in instance network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d40d56-25cd-4911-8468-5e7d31c7a575]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebe8a133-a2d1-48d9-a9eb-7cc51a32daf2 req-ff573744-0515-4fec-a4f6-ff7e83e5abdb service nova] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0924f2b2-7ef2-4203-b87a-80161427331a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkjtRAVG {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkjtRAVG" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[34483351-d661-4b39-8729-025ad3afe70b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkjtRAVG'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[106db2a1-60f4-47b2-b122-3f7295fd2ad8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487e7ba-3d77-4482-bd36-97e196d774de]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c825fb-0574-49f0-8325-7c9e2175b45b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260]
Aug 17 04:03:54 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260] successful.
Aug 17 04:03:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[db921e30-ecf2-4705-ac8b-f34695605c44]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94eb17b-b404-4c99-b365-a103963c9a36]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:03:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:237d10a1-35b8-462d-ad2a-dcdd4bdaea8f (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:03:54 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:03:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.040s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9a52f-3022-4443-9f9b-1b406206db3c]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkjtRAVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:03:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23832643534383538', 'path': '/dev/sdg'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832643534383538', 'path': '/dev/sdg'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lazy-loading 'pci_devices' on Instance uuid dd0181a5-64af-4df2-854e-4703c76fd6e7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:03:55 user nova-compute[72793]:   <uuid>dd0181a5-64af-4df2-854e-4703c76fd6e7</uuid>
Aug 17 04:03:55 user nova-compute[72793]:   <name>instance-00000012</name>
Aug 17 04:03:55 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:03:55 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:03:55 user nova-compute[72793]:   <metadata>
Aug 17 04:03:55 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:03:55 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:03:55 user nova-compute[72793]:       <nova:name>tempest-device-tagging-server-961871553</nova:name>
Aug 17 04:03:55 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:03:48</nova:creationTime>
Aug 17 04:03:55 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:03:55 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:03:55 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:03:55 user nova-compute[72793]:       <nova:owner>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:user uuid="228663705d3d4379984c1e0ce148ee96">tempest-TaggedBootDevicesTest_v242-1912027053-project-member</nova:user>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:project uuid="116148bcb3af453983d87c6e9275d92c">tempest-TaggedBootDevicesTest_v242-1912027053</nova:project>
Aug 17 04:03:55 user nova-compute[72793]:       </nova:owner>
Aug 17 04:03:55 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:03:55 user nova-compute[72793]:       <nova:ports>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="c2671b4e-a6e4-46d2-88f8-6441507b41b5">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="831eb634-f3a3-4e63-89e5-54b481de69e7">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="59341503-9546-4ede-810c-a4e75084eeb6">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="2031f963-6ab5-4fe8-b423-8f4cef9ee9b9">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="98580878-b000-4d2f-a896-7e2470e9af62">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.1.1.218" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="6b615dba-5e5b-4ef9-9110-b1babcb22539">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:         <nova:port uuid="b92bfd5c-f326-47d3-b825-af2d680b8078">
Aug 17 04:03:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 04:03:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:03:55 user nova-compute[72793]:       </nova:ports>
Aug 17 04:03:55 user nova-compute[72793]:     </nova:instance>
Aug 17 04:03:55 user nova-compute[72793]:   </metadata>
Aug 17 04:03:55 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:03:55 user nova-compute[72793]:     <system>
Aug 17 04:03:55 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:03:55 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:03:55 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:03:55 user nova-compute[72793]:       <entry name="serial">dd0181a5-64af-4df2-854e-4703c76fd6e7</entry>
Aug 17 04:03:55 user nova-compute[72793]:       <entry name="uuid">dd0181a5-64af-4df2-854e-4703c76fd6e7</entry>
Aug 17 04:03:55 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:03:55 user nova-compute[72793]:     </system>
Aug 17 04:03:55 user nova-compute[72793]:   </sysinfo>
Aug 17 04:03:55 user nova-compute[72793]:   <os>
Aug 17 04:03:55 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:03:55 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:03:55 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:03:55 user nova-compute[72793]:   </os>
Aug 17 04:03:55 user nova-compute[72793]:   <features>
Aug 17 04:03:55 user nova-compute[72793]:     <acpi/>
Aug 17 04:03:55 user nova-compute[72793]:     <apic/>
Aug 17 04:03:55 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:03:55 user nova-compute[72793]:   </features>
Aug 17 04:03:55 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:03:55 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:03:55 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:03:55 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:03:55 user nova-compute[72793]:   </clock>
Aug 17 04:03:55 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:03:55 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:03:55 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:03:55 user nova-compute[72793]:   </cpu>
Aug 17 04:03:55 user nova-compute[72793]:   <devices>
Aug 17 04:03:55 user nova-compute[72793]:     <disk type="file" device="cdrom">
Aug 17 04:03:55 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 04:03:55 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7/disk.config"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="hda" bus="ide"/>
Aug 17 04:03:55 user nova-compute[72793]:     </disk>
Aug 17 04:03:55 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:03:55 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:55 user nova-compute[72793]:       <source dev="/dev/sdd"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <serial>49dc4f36-f4bf-4008-995f-7b0f1c9c755d</serial>
Aug 17 04:03:55 user nova-compute[72793]:     </disk>
Aug 17 04:03:55 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:03:55 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:55 user nova-compute[72793]:       <source dev="/dev/sdf"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <serial>fa192701-fc9e-4df7-b12c-e0434337a230</serial>
Aug 17 04:03:55 user nova-compute[72793]:     </disk>
Aug 17 04:03:55 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:03:55 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:03:55 user nova-compute[72793]:       <source dev="/dev/sdg"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="vdc" bus="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <serial>a96f7082-5584-4d3e-8cde-5e01383748eb</serial>
Aug 17 04:03:55 user nova-compute[72793]:     </disk>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:8e:82:e2"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tapc2671b4e-a6"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:8e:10:48"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tap831eb634-f3"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:3b:9c:12"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tap59341503-95"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:1d:87:4b"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tap2031f963-6a"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:54:44:68"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tap98580878-b0"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:86:b1:26"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tap6b615dba-5e"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:03:55 user nova-compute[72793]:       <mac address="fa:16:3e:3c:c4:37"/>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:03:55 user nova-compute[72793]:       <target dev="tapb92bfd5c-f3"/>
Aug 17 04:03:55 user nova-compute[72793]:     </interface>
Aug 17 04:03:55 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:03:55 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7/console.log" append="off"/>
Aug 17 04:03:55 user nova-compute[72793]:     </serial>
Aug 17 04:03:55 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:03:55 user nova-compute[72793]:     <video>
Aug 17 04:03:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:03:55 user nova-compute[72793]:     </video>
Aug 17 04:03:55 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:03:55 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:03:55 user nova-compute[72793]:     </rng>
Aug 17 04:03:55 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:03:55 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:03:55 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:03:55 user nova-compute[72793]:     </memballoon>
Aug 17 04:03:55 user nova-compute[72793]:   </devices>
Aug 17 04:03:55 user nova-compute[72793]: </domain>
Aug 17 04:03:55 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2671b4e-a6, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2671b4e-a6, col_values=(('external_ids', {'iface-id': 'c2671b4e-a6e4-46d2-88f8-6441507b41b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:82:e2', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6')
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap831eb634-f3, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap831eb634-f3, col_values=(('external_ids', {'iface-id': '831eb634-f3a3-4e63-89e5-54b481de69e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:10:48', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3')
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59341503-95, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59341503-95, col_values=(('external_ids', {'iface-id': '59341503-9546-4ede-810c-a4e75084eeb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:9c:12', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-41c826d7-c639-41df-9d53-49bda1c6b79a req-683ad868-753e-4db5-b353-da1b0e43076f service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-41c826d7-c639-41df-9d53-49bda1c6b79a req-683ad868-753e-4db5-b353-da1b0e43076f service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-41c826d7-c639-41df-9d53-49bda1c6b79a req-683ad868-753e-4db5-b353-da1b0e43076f service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-41c826d7-c639-41df-9d53-49bda1c6b79a req-683ad868-753e-4db5-b353-da1b0e43076f service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-41c826d7-c639-41df-9d53-49bda1c6b79a req-683ad868-753e-4db5-b353-da1b0e43076f service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:55 user nova-compute[72793]: WARNING nova.compute.manager [req-41c826d7-c639-41df-9d53-49bda1c6b79a req-683ad868-753e-4db5-b353-da1b0e43076f service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state building and task_state spawning.
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95')
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2031f963-6a, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2031f963-6a, col_values=(('external_ids', {'iface-id': '2031f963-6ab5-4fe8-b423-8f4cef9ee9b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:87:4b', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a')
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98580878-b0, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98580878-b0, col_values=(('external_ids', {'iface-id': '98580878-b000-4d2f-a896-7e2470e9af62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:44:68', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0')
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b615dba-5e, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b615dba-5e, col_values=(('external_ids', {'iface-id': '6b615dba-5e5b-4ef9-9110-b1babcb22539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:b1:26', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e')
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb92bfd5c-f3, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb92bfd5c-f3, col_values=(('external_ids', {'iface-id': 'b92bfd5c-f326-47d3-b825-af2d680b8078', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:c4:37', 'vm-uuid': 'dd0181a5-64af-4df2-854e-4703c76fd6e7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: INFO os_vif [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3')
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-5bfac964-251b-4136-83a3-ed72e69cc070 req-57b239f1-a605-4b55-8b21-9f46f32d2151 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5bfac964-251b-4136-83a3-ed72e69cc070 req-57b239f1-a605-4b55-8b21-9f46f32d2151 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5bfac964-251b-4136-83a3-ed72e69cc070 req-57b239f1-a605-4b55-8b21-9f46f32d2151 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5bfac964-251b-4136-83a3-ed72e69cc070 req-57b239f1-a605-4b55-8b21-9f46f32d2151 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-5bfac964-251b-4136-83a3-ed72e69cc070 req-57b239f1-a605-4b55-8b21-9f46f32d2151 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:56 user nova-compute[72793]: WARNING nova.compute.manager [req-5bfac964-251b-4136-83a3-ed72e69cc070 req-57b239f1-a605-4b55-8b21-9f46f32d2151 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] No BDM found with device name hda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] No VIF found with MAC fa:16:3e:8e:82:e2, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] No VIF found with MAC fa:16:3e:54:44:68, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:03:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Using config drive
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Creating config drive at /opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7/disk.config
Aug 17 04:03:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwjo5kppr {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:03:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwjo5kppr" returned: 0 in 0.078s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-29ce3bc4-5774-459e-94b2-d091b532e702 req-e00a03b4-eb80-4e81-b54a-ca11b6740ec5 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-29ce3bc4-5774-459e-94b2-d091b532e702 req-e00a03b4-eb80-4e81-b54a-ca11b6740ec5 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-29ce3bc4-5774-459e-94b2-d091b532e702 req-e00a03b4-eb80-4e81-b54a-ca11b6740ec5 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-29ce3bc4-5774-459e-94b2-d091b532e702 req-e00a03b4-eb80-4e81-b54a-ca11b6740ec5 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-29ce3bc4-5774-459e-94b2-d091b532e702 req-e00a03b4-eb80-4e81-b54a-ca11b6740ec5 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:57 user nova-compute[72793]: WARNING nova.compute.manager [req-29ce3bc4-5774-459e-94b2-d091b532e702 req-e00a03b4-eb80-4e81-b54a-ca11b6740ec5 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state building and task_state spawning.
Aug 17 04:03:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:03:58 user nova-compute[72793]: WARNING nova.compute.manager [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state resized and task_state resize_reverting.
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing instance network info cache due to event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.network.neutron [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245038.9585454, 0caea72b-8769-4feb-ac34-5904ba45308f => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:58 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] VM Resumed (Lifecycle Event)
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:03:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance spawned successfully.
Aug 17 04:03:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245038.9633052, 0caea72b-8769-4feb-ac34-5904ba45308f => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] VM Started (Lifecycle Event)
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Took 11.45 seconds to spawn the instance on the hypervisor.
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245039.2830615, 07328c90-993b-4b0c-8673-04c850aae29c => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Resumed (Lifecycle Event)
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance running successfully.
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] finish_revert_migration finished successfully. {{(pid=72793) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Took 15.50 seconds to build instance.
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245039.2847726, 07328c90-993b-4b0c-8673-04c850aae29c => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Started (Lifecycle Event)
Aug 17 04:03:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ae54f361-6ffc-43fd-ba1c-217aa9fdcc70 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.634s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.147s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 04:03:59 user nova-compute[72793]: INFO nova.compute.manager [None req-fa3dacbd-06e5-471e-b6b9-2af8cc15219f tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance to original state: 'active'
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:03:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:00 user nova-compute[72793]: WARNING nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 for instance with vm_state building and task_state spawning.
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:00 user nova-compute[72793]: WARNING nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 for instance with vm_state building and task_state spawning.
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:00 user nova-compute[72793]: WARNING nova.compute.manager [req-46153224-255f-4914-9bcd-f8e5b701f37f req-9541d580-1530-46f5-8f32-8b27086349c6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 for instance with vm_state building and task_state spawning.
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updated VIF entry in instance network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaf9264-7db9-46cb-a265-5fef606a2588 req-5c83e3b5-8f46-4b3d-9751-ad989613d592 service nova] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-f42066c3-a602-472b-a22b-75eefa1b32e7 req-e523d725-3bfa-433c-b6f5-1e73084e8d86 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f42066c3-a602-472b-a22b-75eefa1b32e7 req-e523d725-3bfa-433c-b6f5-1e73084e8d86 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f42066c3-a602-472b-a22b-75eefa1b32e7 req-e523d725-3bfa-433c-b6f5-1e73084e8d86 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f42066c3-a602-472b-a22b-75eefa1b32e7 req-e523d725-3bfa-433c-b6f5-1e73084e8d86 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-f42066c3-a602-472b-a22b-75eefa1b32e7 req-e523d725-3bfa-433c-b6f5-1e73084e8d86 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:00 user nova-compute[72793]: WARNING nova.compute.manager [req-f42066c3-a602-472b-a22b-75eefa1b32e7 req-e523d725-3bfa-433c-b6f5-1e73084e8d86 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 for instance with vm_state building and task_state spawning.
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-730b6053-5f9b-464a-b856-b2ea0f4ce510 req-5ec0d6c1-52ce-4f6b-82ba-970660320adb service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-730b6053-5f9b-464a-b856-b2ea0f4ce510 req-5ec0d6c1-52ce-4f6b-82ba-970660320adb service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-730b6053-5f9b-464a-b856-b2ea0f4ce510 req-5ec0d6c1-52ce-4f6b-82ba-970660320adb service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-730b6053-5f9b-464a-b856-b2ea0f4ce510 req-5ec0d6c1-52ce-4f6b-82ba-970660320adb service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-730b6053-5f9b-464a-b856-b2ea0f4ce510 req-5ec0d6c1-52ce-4f6b-82ba-970660320adb service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:02 user nova-compute[72793]: WARNING nova.compute.manager [req-730b6053-5f9b-464a-b856-b2ea0f4ce510 req-5ec0d6c1-52ce-4f6b-82ba-970660320adb service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 for instance with vm_state building and task_state spawning.
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-d4887515-67f9-49b2-b28b-59b9063edb58 req-89be93b5-51f9-4b25-9a5d-aa32e43a7e87 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4887515-67f9-49b2-b28b-59b9063edb58 req-89be93b5-51f9-4b25-9a5d-aa32e43a7e87 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4887515-67f9-49b2-b28b-59b9063edb58 req-89be93b5-51f9-4b25-9a5d-aa32e43a7e87 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4887515-67f9-49b2-b28b-59b9063edb58 req-89be93b5-51f9-4b25-9a5d-aa32e43a7e87 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-d4887515-67f9-49b2-b28b-59b9063edb58 req-89be93b5-51f9-4b25-9a5d-aa32e43a7e87 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:02 user nova-compute[72793]: WARNING nova.compute.manager [req-d4887515-67f9-49b2-b28b-59b9063edb58 req-89be93b5-51f9-4b25-9a5d-aa32e43a7e87 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 for instance with vm_state building and task_state spawning.
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:02 user nova-compute[72793]: WARNING nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 for instance with vm_state building and task_state spawning.
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:02 user nova-compute[72793]: WARNING nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 for instance with vm_state building and task_state spawning.
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:02 user nova-compute[72793]: WARNING nova.compute.manager [req-edce04bf-5717-412a-a1dd-dd0c086cbe26 req-b1d0954c-d3aa-4bf1-80ba-d04369ec4728 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 for instance with vm_state building and task_state spawning.
Aug 17 04:04:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating instance_info_cache with network_info: [{"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-62329071-aa56-4d72-9053-e84606823cd1" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245044.4945314, dd0181a5-64af-4df2-854e-4703c76fd6e7 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] VM Resumed (Lifecycle Event)
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance spawned successfully.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245044.4964592, dd0181a5-64af-4df2-854e-4703c76fd6e7 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] VM Started (Lifecycle Event)
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Took 16.30 seconds to spawn the instance on the hypervisor.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:04 user nova-compute[72793]: WARNING nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 for instance with vm_state building and task_state spawning.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:04 user nova-compute[72793]: WARNING nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 for instance with vm_state building and task_state spawning.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:04 user nova-compute[72793]: WARNING nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 for instance with vm_state building and task_state spawning.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:04 user nova-compute[72793]: WARNING nova.compute.manager [req-c977664f-0078-4dde-ad16-6fcec7a2c442 req-f8f7a2a7-5bb0-45a5-958d-6abf8b1ba8a4 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 for instance with vm_state building and task_state spawning.
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Took 59.74 seconds to build instance.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-974877cd-7875-4dae-91dc-73f71b981cfb tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 59.867s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.607s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 17 04:04:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:04:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:06 user nova-compute[72793]: INFO nova.compute.manager [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Terminating instance
Aug 17 04:04:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-e6fc2a3a-06c2-4674-9f54-621067a5e92d req-1fd221c6-a6f2-418f-83c9-4dcd621793cf service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e6fc2a3a-06c2-4674-9f54-621067a5e92d req-1fd221c6-a6f2-418f-83c9-4dcd621793cf service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e6fc2a3a-06c2-4674-9f54-621067a5e92d req-1fd221c6-a6f2-418f-83c9-4dcd621793cf service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e6fc2a3a-06c2-4674-9f54-621067a5e92d req-1fd221c6-a6f2-418f-83c9-4dcd621793cf service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-e6fc2a3a-06c2-4674-9f54-621067a5e92d req-1fd221c6-a6f2-418f-83c9-4dcd621793cf service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:06 user nova-compute[72793]: WARNING nova.compute.manager [req-e6fc2a3a-06c2-4674-9f54-621067a5e92d req-1fd221c6-a6f2-418f-83c9-4dcd621793cf service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 for instance with vm_state active and task_state None.
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Instance destroyed successfully.
Aug 17 04:04:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lazy-loading 'resources' on Instance uuid 62329071-aa56-4d72-9053-e84606823cd1 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-90886938',display_name='tempest-VolumesAdminNegativeTest-server-90886938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-90886938',id=4,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnKoEiWtcq/eyzJ+6JUOZwtnrS0xeMp8tv93xbyxnaUpoEKx+NHI9oimh8i7D8axHPpK0fkufXaYi/ZK76hJ0qfjgPPbadr7rSohsuQelqLbf3JWioxJkbkQqX4mEOJgg==',key_name='tempest-keypair-1493695895',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584b479f01844391a15d9b00afc60453',ramdisk_id='',reservation_id='r-rf0epvtj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-540254454',owner_user_name='tempest-VolumesAdminNegativeTest-540254454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82e025f0dc8745b3bf13231832816033',uuid=62329071-aa56-4d72-9053-e84606823cd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converting VIF {"id": "1882c318-973b-4db1-940f-1e0613b27897", "address": "fa:16:3e:96:24:8a", "network": {"id": "1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-248615552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584b479f01844391a15d9b00afc60453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1882c318-97", "ovs_interfaceid": "1882c318-973b-4db1-940f-1e0613b27897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG os_vif [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1882c318-97, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:04:07 user nova-compute[72793]: INFO os_vif [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:24:8a,bridge_name='br-int',has_traffic_filtering=True,id=1882c318-973b-4db1-940f-1e0613b27897,network=Network(1f2c4192-b8b0-4b1c-b6e0-b02e24172ee6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1882c318-97')
Aug 17 04:04:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Deleting instance files /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1_del
Aug 17 04:04:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Deletion of /opt/stack/data/nova/instances/62329071-aa56-4d72-9053-e84606823cd1_del complete
Aug 17 04:04:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:07 user nova-compute[72793]: INFO nova.compute.manager [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 17 04:04:07 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:04:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:08 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:08 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7772MB free_disk=25.669219970703125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62329071-aa56-4d72-9053-e84606823cd1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 245698d6-2693-404a-b365-e17fc5665259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 0caea72b-8769-4feb-ac34-5904ba45308f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-a32a334b-cb95-4aac-a447-78311148399e req-c45ab90d-52da-463d-a9a9-73bfb1707384 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-vif-unplugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a32a334b-cb95-4aac-a447-78311148399e req-c45ab90d-52da-463d-a9a9-73bfb1707384 service nova] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a32a334b-cb95-4aac-a447-78311148399e req-c45ab90d-52da-463d-a9a9-73bfb1707384 service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a32a334b-cb95-4aac-a447-78311148399e req-c45ab90d-52da-463d-a9a9-73bfb1707384 service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-a32a334b-cb95-4aac-a447-78311148399e req-c45ab90d-52da-463d-a9a9-73bfb1707384 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] No waiting events found dispatching network-vif-unplugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-a32a334b-cb95-4aac-a447-78311148399e req-c45ab90d-52da-463d-a9a9-73bfb1707384 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-vif-unplugged-1882c318-973b-4db1-940f-1e0613b27897 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.032s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.223s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:04:09 user nova-compute[72793]: INFO nova.compute.claims [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Claim successful on node user
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:09 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Took 2.41 seconds to deallocate network for instance.
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-9284a40f-b243-4360-a55e-468f1ec0c28f req-ee5deaed-54aa-4ce6-b83a-fa45fce71aac service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-vif-deleted-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:04:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.237s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:04:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.policy [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7fa68c3f41e4c07b1026e56ab3b4852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbcbbda6abba4007a6055ee0f9c01c33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:04:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Creating image(s)
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.655s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:10 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Deleted allocations for instance 62329071-aa56-4d72-9053-e84606823cd1
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.294s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-a84f2634-c47b-49c4-b0ff-86c5e2829ff4 req-3e840409-e454-4a4d-8ba7-80c049209a96 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received event network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a84f2634-c47b-49c4-b0ff-86c5e2829ff4 req-3e840409-e454-4a4d-8ba7-80c049209a96 service nova] Acquiring lock "62329071-aa56-4d72-9053-e84606823cd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a84f2634-c47b-49c4-b0ff-86c5e2829ff4 req-3e840409-e454-4a4d-8ba7-80c049209a96 service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a84f2634-c47b-49c4-b0ff-86c5e2829ff4 req-3e840409-e454-4a4d-8ba7-80c049209a96 service nova] Lock "62329071-aa56-4d72-9053-e84606823cd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-a84f2634-c47b-49c4-b0ff-86c5e2829ff4 req-3e840409-e454-4a4d-8ba7-80c049209a96 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] No waiting events found dispatching network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:10 user nova-compute[72793]: WARNING nova.compute.manager [req-a84f2634-c47b-49c4-b0ff-86c5e2829ff4 req-3e840409-e454-4a4d-8ba7-80c049209a96 service nova] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Received unexpected event network-vif-plugged-1882c318-973b-4db1-940f-1e0613b27897 for instance with vm_state deleted and task_state None.
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bad2a6b0-25c8-4c5a-bb10-622e52b5e9c6 tempest-VolumesAdminNegativeTest-540254454 tempest-VolumesAdminNegativeTest-540254454-project-member] Lock "62329071-aa56-4d72-9053-e84606823cd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.815s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk 1073741824" returned: 0 in 0.067s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.226s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Successfully created port: 06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Cannot resize image /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'migration_context' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Ensure instance console log exists: /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:12 user nova-compute[72793]: INFO nova.compute.manager [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Rebooting instance
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Successfully updated port: 06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing instance network info cache due to event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance network_info: |[{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.neutron [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Start _get_guest_xml network_info=[{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:04:12 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:12 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267099843',display_name='tempest-ServerStableDeviceRescueTest-server-1267099843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267099843',id=20,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSM5dElm1GppRv3T2Lvsupvvf5j/KDOnFCs4lE0qN6Bcc0viR6WUM7+FkycjToeoGztWOGAssgzvU4SZTkv61Gg3X14wBlMQdd5/PkUUTFiFp/VW/mKukrQ1hL5DwM8dw==',key_name='tempest-keypair-56794815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbcbbda6abba4007a6055ee0f9c01c33',ramdisk_id='',reservation_id='r-i6gy50hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-621052297',owner_user_name='tempest-ServerStableDeviceRescueTest-621052297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7fa68c3f41e4c07b1026e56ab3b4852',uuid=6c830030-be1e-4aa1-a583-7fb997d51893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converting VIF {"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:12 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:04:13 user nova-compute[72793]:   <uuid>6c830030-be1e-4aa1-a583-7fb997d51893</uuid>
Aug 17 04:04:13 user nova-compute[72793]:   <name>instance-00000014</name>
Aug 17 04:04:13 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:04:13 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:04:13 user nova-compute[72793]:   <metadata>
Aug 17 04:04:13 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:04:13 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:04:13 user nova-compute[72793]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1267099843</nova:name>
Aug 17 04:04:13 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:04:12</nova:creationTime>
Aug 17 04:04:13 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:04:13 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:04:13 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:04:13 user nova-compute[72793]:       <nova:owner>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:user uuid="b7fa68c3f41e4c07b1026e56ab3b4852">tempest-ServerStableDeviceRescueTest-621052297-project-member</nova:user>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:project uuid="cbcbbda6abba4007a6055ee0f9c01c33">tempest-ServerStableDeviceRescueTest-621052297</nova:project>
Aug 17 04:04:13 user nova-compute[72793]:       </nova:owner>
Aug 17 04:04:13 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:04:13 user nova-compute[72793]:       <nova:ports>
Aug 17 04:04:13 user nova-compute[72793]:         <nova:port uuid="06b66834-5f15-4470-88bd-3bc5fda3c059">
Aug 17 04:04:13 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 04:04:13 user nova-compute[72793]:         </nova:port>
Aug 17 04:04:13 user nova-compute[72793]:       </nova:ports>
Aug 17 04:04:13 user nova-compute[72793]:     </nova:instance>
Aug 17 04:04:13 user nova-compute[72793]:   </metadata>
Aug 17 04:04:13 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:04:13 user nova-compute[72793]:     <system>
Aug 17 04:04:13 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:04:13 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:04:13 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:04:13 user nova-compute[72793]:       <entry name="serial">6c830030-be1e-4aa1-a583-7fb997d51893</entry>
Aug 17 04:04:13 user nova-compute[72793]:       <entry name="uuid">6c830030-be1e-4aa1-a583-7fb997d51893</entry>
Aug 17 04:04:13 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:04:13 user nova-compute[72793]:     </system>
Aug 17 04:04:13 user nova-compute[72793]:   </sysinfo>
Aug 17 04:04:13 user nova-compute[72793]:   <os>
Aug 17 04:04:13 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:04:13 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:04:13 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:04:13 user nova-compute[72793]:   </os>
Aug 17 04:04:13 user nova-compute[72793]:   <features>
Aug 17 04:04:13 user nova-compute[72793]:     <acpi/>
Aug 17 04:04:13 user nova-compute[72793]:     <apic/>
Aug 17 04:04:13 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:04:13 user nova-compute[72793]:   </features>
Aug 17 04:04:13 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:04:13 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:04:13 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:04:13 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:04:13 user nova-compute[72793]:   </clock>
Aug 17 04:04:13 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:04:13 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:04:13 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:04:13 user nova-compute[72793]:   </cpu>
Aug 17 04:04:13 user nova-compute[72793]:   <devices>
Aug 17 04:04:13 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:04:13 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:04:13 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk"/>
Aug 17 04:04:13 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:04:13 user nova-compute[72793]:     </disk>
Aug 17 04:04:13 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:04:13 user nova-compute[72793]:       <mac address="fa:16:3e:8d:a0:36"/>
Aug 17 04:04:13 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:13 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:04:13 user nova-compute[72793]:       <target dev="tap06b66834-5f"/>
Aug 17 04:04:13 user nova-compute[72793]:     </interface>
Aug 17 04:04:13 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:04:13 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/console.log" append="off"/>
Aug 17 04:04:13 user nova-compute[72793]:     </serial>
Aug 17 04:04:13 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:04:13 user nova-compute[72793]:     <video>
Aug 17 04:04:13 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:13 user nova-compute[72793]:     </video>
Aug 17 04:04:13 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:04:13 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:04:13 user nova-compute[72793]:     </rng>
Aug 17 04:04:13 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:04:13 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:04:13 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:04:13 user nova-compute[72793]:     </memballoon>
Aug 17 04:04:13 user nova-compute[72793]:   </devices>
Aug 17 04:04:13 user nova-compute[72793]: </domain>
Aug 17 04:04:13 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267099843',display_name='tempest-ServerStableDeviceRescueTest-server-1267099843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267099843',id=20,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSM5dElm1GppRv3T2Lvsupvvf5j/KDOnFCs4lE0qN6Bcc0viR6WUM7+FkycjToeoGztWOGAssgzvU4SZTkv61Gg3X14wBlMQdd5/PkUUTFiFp/VW/mKukrQ1hL5DwM8dw==',key_name='tempest-keypair-56794815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbcbbda6abba4007a6055ee0f9c01c33',ramdisk_id='',reservation_id='r-i6gy50hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-621052297',owner_user_name='tempest-ServerStableDeviceRescueTest-621052297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7fa68c3f41e4c07b1026e56ab3b4852',uuid=6c830030-be1e-4aa1-a583-7fb997d51893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converting VIF {"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG os_vif [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06b66834-5f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06b66834-5f, col_values=(('external_ids', {'iface-id': '06b66834-5f15-4470-88bd-3bc5fda3c059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:a0:36', 'vm-uuid': '6c830030-be1e-4aa1-a583-7fb997d51893'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: INFO os_vif [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f')
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No VIF found with MAC fa:16:3e:8d:a0:36, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updated VIF entry in instance network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-78ecc46d-3021-4597-a029-fc427aa83f33 req-a92a971f-95f3-4836-830d-bc798ade0956 service nova] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-8aea6f91-d292-40da-8194-d3050ca8d681 req-956e925a-108f-42c8-954f-56245b1334ff service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-unplugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8aea6f91-d292-40da-8194-d3050ca8d681 req-956e925a-108f-42c8-954f-56245b1334ff service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8aea6f91-d292-40da-8194-d3050ca8d681 req-956e925a-108f-42c8-954f-56245b1334ff service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8aea6f91-d292-40da-8194-d3050ca8d681 req-956e925a-108f-42c8-954f-56245b1334ff service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-8aea6f91-d292-40da-8194-d3050ca8d681 req-956e925a-108f-42c8-954f-56245b1334ff service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-unplugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:13 user nova-compute[72793]: WARNING nova.compute.manager [req-8aea6f91-d292-40da-8194-d3050ca8d681 req-956e925a-108f-42c8-954f-56245b1334ff service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-unplugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 04:04:14 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance destroyed successfully.
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'resources' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812116502',display_name='tempest-TestMinimumBasicScenario-server-812116502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812116502',id=13,image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN79szzICC00Dbk3h4sD5anhGgYMGJBeVvfL93fsOxN0m2IUuCaq+YaMXyw1pWaDeXYjdWRstBu/R49xPZgXW6kroj7sIPAiABNGniM4BcfeES55lSmGI/QwS9FaKK7nRw==',key_name='tempest-TestMinimumBasicScenario-574191377',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-6qfcdjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:13Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=245698d6-2693-404a-b365-e17fc5665259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e78924b-74, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:14 user nova-compute[72793]: INFO os_vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74')
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:04:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[10580612-bd88-4b27-a65a-252b74a40785]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b338544-53c1-4dc2-95ea-9ed8622a9859]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02f4280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d55361-47c2-4361-b67f-4986e6b90476]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ba80a7-51aa-430b-8aa5-89b10057197b]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8501ee-18a4-4dd2-9549-8b0d3abd479c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4febd2-bf5c-4130-aeed-a625b78d240d]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dda1a8d-dc37-4ef2-a027-237a3a658145]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3913308a-57c0-4b66-b185-11ca76157774]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]
Aug 17 04:04:14 user nova-compute[72793]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.
Aug 17 04:04:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce502ae0-bbd3-460e-a8f1-4e59471bd4fb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] <== disconnect_volume: return (364ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Start _get_guest_xml network_info=[{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e2a60a23-19a3-4dee-8a4c-11628e30ec03,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': 'e2a60a23-19a3-4dee-8a4c-11628e30ec03'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '245698d6-2693-404a-b365-e17fc5665259', 'attached_at': '', 'detached_at': '', 'volume_id': '5b1915cc-f648-4e44-9bd2-e3cea7728bbf', 'serial': '5b1915cc-f648-4e44-9bd2-e3cea7728bbf'}, 'guest_format': None, 'attachment_id': 'aa05e8a3-1f0d-4247-8655-69655361242b', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:04:14 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:14 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e2a60a23-19a3-4dee-8a4c-11628e30ec03,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:04:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:14 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a514c3-22ea-4007-81eb-e0696eff7855]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:04:14 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d2cf9-02c5-4193-ba6c-455a72b75940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf] added
Aug 17 04:04:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc55b1f-381b-4dc7-88a7-87f33dd01b7c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f01f6-9f94-4768-b702-a9159df79326]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifnymzru {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ifnymzru" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a872c-83a2-483e-b925-38081e6a4879]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ifnymzru'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[742ba1bd-2c31-426c-a8ea-8cb4d0500a1d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe31d98-0ea6-4d8e-b59d-cd1552bfc3e8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:14 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67cb8de-d033-4f68-99f0-92da8e1e75fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]
Aug 17 04:04:15 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.
Aug 17 04:04:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94800a8-e233-49b0-b39c-0e236220ce64]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6061e20-a4fd-400d-91b8-5b70d3efd44f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:15 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.056s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5cef81-5969-4ffd-b059-a9a20cab3a2b]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-8d9282fd-1c94-4f37-a8e9-c4b557fd9e52 req-f7624bea-11f5-4cc3-ba53-32b1c97e6c3d service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8d9282fd-1c94-4f37-a8e9-c4b557fd9e52 req-f7624bea-11f5-4cc3-ba53-32b1c97e6c3d service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8d9282fd-1c94-4f37-a8e9-c4b557fd9e52 req-f7624bea-11f5-4cc3-ba53-32b1c97e6c3d service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8d9282fd-1c94-4f37-a8e9-c4b557fd9e52 req-f7624bea-11f5-4cc3-ba53-32b1c97e6c3d service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-8d9282fd-1c94-4f37-a8e9-c4b557fd9e52 req-f7624bea-11f5-4cc3-ba53-32b1c97e6c3d service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:15 user nova-compute[72793]: WARNING nova.compute.manager [req-8d9282fd-1c94-4f37-a8e9-c4b557fd9e52 req-f7624bea-11f5-4cc3-ba53-32b1c97e6c3d service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state building and task_state spawning.
Aug 17 04:04:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-e56b4c04-103d-4cc1-9420-5c85997bcc3e req-ade89b92-409c-4970-b84f-f586cb258197 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e56b4c04-103d-4cc1-9420-5c85997bcc3e req-ade89b92-409c-4970-b84f-f586cb258197 service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e56b4c04-103d-4cc1-9420-5c85997bcc3e req-ade89b92-409c-4970-b84f-f586cb258197 service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e56b4c04-103d-4cc1-9420-5c85997bcc3e req-ade89b92-409c-4970-b84f-f586cb258197 service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-e56b4c04-103d-4cc1-9420-5c85997bcc3e req-ade89b92-409c-4970-b84f-f586cb258197 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:15 user nova-compute[72793]: WARNING nova.compute.manager [req-e56b4c04-103d-4cc1-9420-5c85997bcc3e req-ade89b92-409c-4970-b84f-f586cb258197 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 04:04:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23861346530653662', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861346530653662', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812116502',display_name='tempest-TestMinimumBasicScenario-server-812116502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812116502',id=13,image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN79szzICC00Dbk3h4sD5anhGgYMGJBeVvfL93fsOxN0m2IUuCaq+YaMXyw1pWaDeXYjdWRstBu/R49xPZgXW6kroj7sIPAiABNGniM4BcfeES55lSmGI/QwS9FaKK7nRw==',key_name='tempest-TestMinimumBasicScenario-574191377',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-6qfcdjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:13Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=245698d6-2693-404a-b365-e17fc5665259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'pci_devices' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:04:16 user nova-compute[72793]:   <uuid>245698d6-2693-404a-b365-e17fc5665259</uuid>
Aug 17 04:04:16 user nova-compute[72793]:   <name>instance-0000000d</name>
Aug 17 04:04:16 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:04:16 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:04:16 user nova-compute[72793]:   <metadata>
Aug 17 04:04:16 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:04:16 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:04:16 user nova-compute[72793]:       <nova:name>tempest-TestMinimumBasicScenario-server-812116502</nova:name>
Aug 17 04:04:16 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:04:14</nova:creationTime>
Aug 17 04:04:16 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:04:16 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:04:16 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:04:16 user nova-compute[72793]:       <nova:owner>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:user uuid="cd805a44490b4a969fd9121571f17bb1">tempest-TestMinimumBasicScenario-660102196-project-member</nova:user>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:project uuid="909f9614d1c64730bdcaf1b4d86516da">tempest-TestMinimumBasicScenario-660102196</nova:project>
Aug 17 04:04:16 user nova-compute[72793]:       </nova:owner>
Aug 17 04:04:16 user nova-compute[72793]:       <nova:root type="image" uuid="e2a60a23-19a3-4dee-8a4c-11628e30ec03"/>
Aug 17 04:04:16 user nova-compute[72793]:       <nova:ports>
Aug 17 04:04:16 user nova-compute[72793]:         <nova:port uuid="0e78924b-74b3-4441-917d-1bd448b0a420">
Aug 17 04:04:16 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:04:16 user nova-compute[72793]:         </nova:port>
Aug 17 04:04:16 user nova-compute[72793]:       </nova:ports>
Aug 17 04:04:16 user nova-compute[72793]:     </nova:instance>
Aug 17 04:04:16 user nova-compute[72793]:   </metadata>
Aug 17 04:04:16 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:04:16 user nova-compute[72793]:     <system>
Aug 17 04:04:16 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:04:16 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:04:16 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:04:16 user nova-compute[72793]:       <entry name="serial">245698d6-2693-404a-b365-e17fc5665259</entry>
Aug 17 04:04:16 user nova-compute[72793]:       <entry name="uuid">245698d6-2693-404a-b365-e17fc5665259</entry>
Aug 17 04:04:16 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:04:16 user nova-compute[72793]:     </system>
Aug 17 04:04:16 user nova-compute[72793]:   </sysinfo>
Aug 17 04:04:16 user nova-compute[72793]:   <os>
Aug 17 04:04:16 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:04:16 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:04:16 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:04:16 user nova-compute[72793]:   </os>
Aug 17 04:04:16 user nova-compute[72793]:   <features>
Aug 17 04:04:16 user nova-compute[72793]:     <acpi/>
Aug 17 04:04:16 user nova-compute[72793]:     <apic/>
Aug 17 04:04:16 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:04:16 user nova-compute[72793]:   </features>
Aug 17 04:04:16 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:04:16 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:04:16 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:04:16 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:04:16 user nova-compute[72793]:   </clock>
Aug 17 04:04:16 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:04:16 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:04:16 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:04:16 user nova-compute[72793]:   </cpu>
Aug 17 04:04:16 user nova-compute[72793]:   <devices>
Aug 17 04:04:16 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:04:16 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:04:16 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk"/>
Aug 17 04:04:16 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:04:16 user nova-compute[72793]:     </disk>
Aug 17 04:04:16 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:04:16 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:04:16 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:04:16 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:04:16 user nova-compute[72793]:       <serial>5b1915cc-f648-4e44-9bd2-e3cea7728bbf</serial>
Aug 17 04:04:16 user nova-compute[72793]:     </disk>
Aug 17 04:04:16 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:04:16 user nova-compute[72793]:       <mac address="fa:16:3e:1e:f6:ad"/>
Aug 17 04:04:16 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:16 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:04:16 user nova-compute[72793]:       <target dev="tap0e78924b-74"/>
Aug 17 04:04:16 user nova-compute[72793]:     </interface>
Aug 17 04:04:16 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:04:16 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/console.log" append="off"/>
Aug 17 04:04:16 user nova-compute[72793]:     </serial>
Aug 17 04:04:16 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:04:16 user nova-compute[72793]:     <video>
Aug 17 04:04:16 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:16 user nova-compute[72793]:     </video>
Aug 17 04:04:16 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:04:16 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:04:16 user nova-compute[72793]:     </rng>
Aug 17 04:04:16 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:04:16 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:04:16 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:04:16 user nova-compute[72793]:     </memballoon>
Aug 17 04:04:16 user nova-compute[72793]:   </devices>
Aug 17 04:04:16 user nova-compute[72793]: </domain>
Aug 17 04:04:16 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda --force-share --output=json" returned: 0 in 0.258s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Cannot resize image /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'migration_context' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-1846be36-ebc4-4b06-96c5-b06eb5ac01c7 req-577b78c3-321e-44a2-b973-0861caca9a43 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1846be36-ebc4-4b06-96c5-b06eb5ac01c7 req-577b78c3-321e-44a2-b973-0861caca9a43 service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1846be36-ebc4-4b06-96c5-b06eb5ac01c7 req-577b78c3-321e-44a2-b973-0861caca9a43 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1846be36-ebc4-4b06-96c5-b06eb5ac01c7 req-577b78c3-321e-44a2-b973-0861caca9a43 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-1846be36-ebc4-4b06-96c5-b06eb5ac01c7 req-577b78c3-321e-44a2-b973-0861caca9a43 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:17 user nova-compute[72793]: WARNING nova.compute.manager [req-1846be36-ebc4-4b06-96c5-b06eb5ac01c7 req-577b78c3-321e-44a2-b973-0861caca9a43 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state building and task_state spawning.
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812116502',display_name='tempest-TestMinimumBasicScenario-server-812116502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812116502',id=13,image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN79szzICC00Dbk3h4sD5anhGgYMGJBeVvfL93fsOxN0m2IUuCaq+YaMXyw1pWaDeXYjdWRstBu/R49xPZgXW6kroj7sIPAiABNGniM4BcfeES55lSmGI/QwS9FaKK7nRw==',key_name='tempest-TestMinimumBasicScenario-574191377',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-6qfcdjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:13Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=245698d6-2693-404a-b365-e17fc5665259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG os_vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e78924b-74, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e78924b-74, col_values=(('external_ids', {'iface-id': '0e78924b-74b3-4441-917d-1bd448b0a420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:f6:ad', 'vm-uuid': '245698d6-2693-404a-b365-e17fc5665259'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:17 user nova-compute[72793]: INFO os_vif [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74')
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245057.7688727, 6c830030-be1e-4aa1-a583-7fb997d51893 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:17 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Resumed (Lifecycle Event)
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:04:17 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance spawned successfully.
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:17 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245057.7729707, 6c830030-be1e-4aa1-a583-7fb997d51893 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:17 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Started (Lifecycle Event)
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:17 user nova-compute[72793]: INFO nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Took 7.46 seconds to spawn the instance on the hypervisor.
Aug 17 04:04:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:17 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:04:18 user nova-compute[72793]: INFO nova.compute.manager [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Took 8.92 seconds to build instance.
Aug 17 04:04:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fe58cae8-113c-4a9c-9578-5636dc3c9afd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.163s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-2e333f95-f195-4d8c-a12b-2c9049f1571e req-f1ddb96d-091e-42bc-9c96-ec79755f6fad service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2e333f95-f195-4d8c-a12b-2c9049f1571e req-f1ddb96d-091e-42bc-9c96-ec79755f6fad service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2e333f95-f195-4d8c-a12b-2c9049f1571e req-f1ddb96d-091e-42bc-9c96-ec79755f6fad service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2e333f95-f195-4d8c-a12b-2c9049f1571e req-f1ddb96d-091e-42bc-9c96-ec79755f6fad service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-2e333f95-f195-4d8c-a12b-2c9049f1571e req-f1ddb96d-091e-42bc-9c96-ec79755f6fad service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:19 user nova-compute[72793]: WARNING nova.compute.manager [req-2e333f95-f195-4d8c-a12b-2c9049f1571e req-f1ddb96d-091e-42bc-9c96-ec79755f6fad service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 04:04:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-032f75e0-13d8-4422-be5f-85c0a6b431bb req-71e932c5-f686-47df-bbc6-08d9953e09ec service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-032f75e0-13d8-4422-be5f-85c0a6b431bb req-71e932c5-f686-47df-bbc6-08d9953e09ec service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-032f75e0-13d8-4422-be5f-85c0a6b431bb req-71e932c5-f686-47df-bbc6-08d9953e09ec service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-032f75e0-13d8-4422-be5f-85c0a6b431bb req-71e932c5-f686-47df-bbc6-08d9953e09ec service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-032f75e0-13d8-4422-be5f-85c0a6b431bb req-71e932c5-f686-47df-bbc6-08d9953e09ec service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:21 user nova-compute[72793]: WARNING nova.compute.manager [req-032f75e0-13d8-4422-be5f-85c0a6b431bb req-71e932c5-f686-47df-bbc6-08d9953e09ec service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state active and task_state reboot_started_hard.
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for 245698d6-2693-404a-b365-e17fc5665259 due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245061.5115113, 245698d6-2693-404a-b365-e17fc5665259 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] VM Resumed (Lifecycle Event)
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:04:21 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance rebooted successfully.
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245061.5136893, 245698d6-2693-404a-b365-e17fc5665259 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] VM Started (Lifecycle Event)
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 04:04:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6dbdd701-17b1-4302-baa1-cc347206232d tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.461s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:22 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245047.1019638, 62329071-aa56-4d72-9053-e84606823cd1 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:22 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 62329071-aa56-4d72-9053-e84606823cd1] VM Stopped (Lifecycle Event)
Aug 17 04:04:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9e34b750-bc66-401d-be10-14971099afa4 None None] [instance: 62329071-aa56-4d72-9053-e84606823cd1] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbNpweIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:04:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:28 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fac063-05d2-414a-ab85-50b29263026d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:04:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5cb279-23d3-4cbb-a445-bc8475e34954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e] added
Aug 17 04:04:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aacd9a0-8f6f-4af0-8146-a27940a700db]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d913ce9-8318-44af-aad7-7230d81f902d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbNpweIG {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WbNpweIG" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d42aa87-cb59-425d-8b3f-7e2f7c116688]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WbNpweIG'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d541888-23bf-41a5-a4b4-87a94bcbc9cc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7d72d-d8c3-447a-81c9-f662488163f8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f12e5b5-b822-4601-8127-81e129bb9f1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260]
Aug 17 04:04:28 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260] successful.
Aug 17 04:04:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c667a1-9b06-4b26-bdf3-f631cc3b47b8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc2c3f-ee52-4da2-b56b-089c40dd7089]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:28 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:04:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[259008a6-e879-4e1f-a76c-b5b33326f543]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:04:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbNpweIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:04:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23833303133363463', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833303133363463', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'flavor' on Instance uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:04:30 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:04:30 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:04:30 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:04:30 user nova-compute[72793]:   <serial>743584db-d218-4613-bf09-cc2bbd95731e</serial>
Aug 17 04:04:30 user nova-compute[72793]: </disk>
Aug 17 04:04:30 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No VIF found with MAC fa:16:3e:2d:06:fb, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:04:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0c68220-b900-45ba-8419-43c6967d6570 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.903s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "d3b38fd0-f823-4a39-927a-52c064339731" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:04:38 user nova-compute[72793]: INFO nova.compute.claims [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Claim successful on node user
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:04:38 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:04:38 user nova-compute[72793]: INFO nova.virt.block_device [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Booting with blank volume at /dev/vda
Aug 17 04:04:38 user nova-compute[72793]: DEBUG nova.policy [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21663e2118004c528a64a7fba2e29ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec39bbf61f45c6963f018159dcb33c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:04:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Successfully created port: 1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:04:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:04:41 user nova-compute[72793]: INFO nova.compute.claims [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Claim successful on node user
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Successfully updated port: 1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-changed-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Refreshing instance network info cache due to event network-changed-1d296636-0862-4eb8-b813-29eeba5b6cd5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] Acquiring lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance network_info: |[{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] Acquired lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Refreshing network info cache for port 1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:04:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:04:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Creating image(s)
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "/opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "/opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "/opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:41 user nova-compute[72793]: DEBUG nova.policy [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d5ebd08ec8d46909028e890b4d1c142', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c068775d4da4d489bdbcfa1a7505683', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.network.neutron [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updated VIF entry in instance network info cache for port 1d296636-0862-4eb8-b813-29eeba5b6cd5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.network.neutron [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.219s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-609be3e9-d602-4797-8a0e-5b6d2d5b530d req-ee2e4561-9a95-488b-9875-79dbeb0db47a service nova] Releasing lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk 1073741824" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Cannot resize image /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lazy-loading 'migration_context' on Instance uuid 921ee52c-1551-4ec1-ae8b-3af43ae32c05 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Ensure instance console log exists: /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Successfully created port: 4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:04:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Successfully updated port: 4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "refresh_cache-921ee52c-1551-4ec1-ae8b-3af43ae32c05" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquired lock "refresh_cache-921ee52c-1551-4ec1-ae8b-3af43ae32c05" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-changed-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Refreshing instance network info cache due to event network-changed-4195b995-1168-4914-b1eb-ae7232ace35f. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] Acquiring lock "refresh_cache-921ee52c-1551-4ec1-ae8b-3af43ae32c05" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:04:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Creating image(s)
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Updating instance_info_cache with network_info: [{"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Releasing lock "refresh_cache-921ee52c-1551-4ec1-ae8b-3af43ae32c05" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Instance network_info: |[{"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] Acquired lock "refresh_cache-921ee52c-1551-4ec1-ae8b-3af43ae32c05" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Refreshing network info cache for port 4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Start _get_guest_xml network_info=[{"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:04:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_brick.utils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk 1073741824" returned: 0 in 0.059s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1053095-f10d-4f2b-957c-66fa6f23baaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1783971542',display_name='tempest-VolumesNegativeTest-instance-1783971542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1783971542',id=22,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c068775d4da4d489bdbcfa1a7505683',ramdisk_id='',reservation_id='r-a28vtm9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-492167290',owner_user_name='tempest-VolumesNegativeTest-492167290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:42Z,user_data=None,user_id='0d5ebd08ec8d46909028e890b4d1c142',uuid=921ee52c-1551-4ec1-ae8b-3af43ae32c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Converting VIF {"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lazy-loading 'pci_devices' on Instance uuid 921ee52c-1551-4ec1-ae8b-3af43ae32c05 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dccfd3-0081-4199-993d-9ab5dabb0678]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:04:44 user nova-compute[72793]:   <uuid>921ee52c-1551-4ec1-ae8b-3af43ae32c05</uuid>
Aug 17 04:04:44 user nova-compute[72793]:   <name>instance-00000016</name>
Aug 17 04:04:44 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:04:44 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:04:44 user nova-compute[72793]:   <metadata>
Aug 17 04:04:44 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:04:44 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:04:44 user nova-compute[72793]:       <nova:name>tempest-VolumesNegativeTest-instance-1783971542</nova:name>
Aug 17 04:04:44 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:04:44</nova:creationTime>
Aug 17 04:04:44 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:04:44 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:04:44 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:04:44 user nova-compute[72793]:       <nova:owner>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:user uuid="0d5ebd08ec8d46909028e890b4d1c142">tempest-VolumesNegativeTest-492167290-project-member</nova:user>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:project uuid="2c068775d4da4d489bdbcfa1a7505683">tempest-VolumesNegativeTest-492167290</nova:project>
Aug 17 04:04:44 user nova-compute[72793]:       </nova:owner>
Aug 17 04:04:44 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:04:44 user nova-compute[72793]:       <nova:ports>
Aug 17 04:04:44 user nova-compute[72793]:         <nova:port uuid="4195b995-1168-4914-b1eb-ae7232ace35f">
Aug 17 04:04:44 user nova-compute[72793]:           <nova:ip type="fixed" address="192.168.233.115" ipVersion="4"/>
Aug 17 04:04:44 user nova-compute[72793]:         </nova:port>
Aug 17 04:04:44 user nova-compute[72793]:       </nova:ports>
Aug 17 04:04:44 user nova-compute[72793]:     </nova:instance>
Aug 17 04:04:44 user nova-compute[72793]:   </metadata>
Aug 17 04:04:44 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:04:44 user nova-compute[72793]:     <system>
Aug 17 04:04:44 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:04:44 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:04:44 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:04:44 user nova-compute[72793]:       <entry name="serial">921ee52c-1551-4ec1-ae8b-3af43ae32c05</entry>
Aug 17 04:04:44 user nova-compute[72793]:       <entry name="uuid">921ee52c-1551-4ec1-ae8b-3af43ae32c05</entry>
Aug 17 04:04:44 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:04:44 user nova-compute[72793]:     </system>
Aug 17 04:04:44 user nova-compute[72793]:   </sysinfo>
Aug 17 04:04:44 user nova-compute[72793]:   <os>
Aug 17 04:04:44 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:04:44 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:04:44 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:04:44 user nova-compute[72793]:   </os>
Aug 17 04:04:44 user nova-compute[72793]:   <features>
Aug 17 04:04:44 user nova-compute[72793]:     <acpi/>
Aug 17 04:04:44 user nova-compute[72793]:     <apic/>
Aug 17 04:04:44 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:04:44 user nova-compute[72793]:   </features>
Aug 17 04:04:44 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:04:44 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:04:44 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:04:44 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:04:44 user nova-compute[72793]:   </clock>
Aug 17 04:04:44 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:04:44 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:04:44 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:04:44 user nova-compute[72793]:   </cpu>
Aug 17 04:04:44 user nova-compute[72793]:   <devices>
Aug 17 04:04:44 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:04:44 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:04:44 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk"/>
Aug 17 04:04:44 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:04:44 user nova-compute[72793]:     </disk>
Aug 17 04:04:44 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:04:44 user nova-compute[72793]:       <mac address="fa:16:3e:a0:a0:84"/>
Aug 17 04:04:44 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:44 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:04:44 user nova-compute[72793]:       <target dev="tap4195b995-11"/>
Aug 17 04:04:44 user nova-compute[72793]:     </interface>
Aug 17 04:04:44 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:04:44 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/console.log" append="off"/>
Aug 17 04:04:44 user nova-compute[72793]:     </serial>
Aug 17 04:04:44 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:04:44 user nova-compute[72793]:     <video>
Aug 17 04:04:44 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:44 user nova-compute[72793]:     </video>
Aug 17 04:04:44 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:04:44 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:04:44 user nova-compute[72793]:     </rng>
Aug 17 04:04:44 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:04:44 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:04:44 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:04:44 user nova-compute[72793]:     </memballoon>
Aug 17 04:04:44 user nova-compute[72793]:   </devices>
Aug 17 04:04:44 user nova-compute[72793]: </domain>
Aug 17 04:04:44 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1783971542',display_name='tempest-VolumesNegativeTest-instance-1783971542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1783971542',id=22,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c068775d4da4d489bdbcfa1a7505683',ramdisk_id='',reservation_id='r-a28vtm9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-492167290',owner_user_name='tempest-VolumesNegativeTest-492167290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:42Z,user_data=None,user_id='0d5ebd08ec8d46909028e890b4d1c142',uuid=921ee52c-1551-4ec1-ae8b-3af43ae32c05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Converting VIF {"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_vif [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4195b995-11, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4195b995-11, col_values=(('external_ids', {'iface-id': '4195b995-1168-4914-b1eb-ae7232ace35f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:a0:84', 'vm-uuid': '921ee52c-1551-4ec1-ae8b-3af43ae32c05'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:44 user nova-compute[72793]: INFO os_vif [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11')
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58a7d84-f0d9-4e62-8bb5-45d2bf7fcc69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d218bd-6e22-4426-9348-bd5c5476a6c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:04:44 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:04:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ad400-fe75-4370-b596-6a99b4ff11ba]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG os_brick.utils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== get_connector_properties: return (305ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating existing volume attachment record: a82c651d-85fb-4159-91b6-77990eb28d1d {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:04:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] No VIF found with MAC fa:16:3e:a0:a0:84, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Cannot resize image /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Ensure instance console log exists: /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Start _get_guest_xml network_info=[{"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ecbd6261-7b55-4225-97c8-bbd02b37aa5a', 'attached_at': '', 'detached_at': '', 'volume_id': '908b6760-985b-4839-ad93-9e0f44af5afd', 'serial': '908b6760-985b-4839-ad93-9e0f44af5afd'}, 'guest_format': None, 'attachment_id': '9559859f-0c13-494e-8f02-a363647f825e', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:45 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 04:04:45 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'vcpu_model' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:04:45 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:45 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:45 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[447eb8e4-c93e-418f-b34e-31b2bed266af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:04:45 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92c9a7-56b4-4a48-863c-9a2fec7c9d6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd] added
Aug 17 04:04:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569f60f-5383-42e5-b209-fa32bbf521dd]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[75069817-99ec-442d-b3c4-9bbac16edf0a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfvHXxRq {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfvHXxRq" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf87771-fd11-4fa1-b51a-86c41389a038]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfvHXxRq'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2174676a-979c-45ab-8ed8-30e72af907c4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[97caa1e6-fca9-4550-abfb-7e82ab0cca5f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Updated VIF entry in instance network info cache for port 4195b995-1168-4914-b1eb-ae7232ace35f. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Updating instance_info_cache with network_info: [{"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d8e9b4-f649-4e05-a047-7b7dda42a7bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]
Aug 17 04:04:45 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.
Aug 17 04:04:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a33d28b-2b9f-44a3-a78f-8bee8040fd39 req-c90b8558-696f-4b50-aec5-fadf5d034c3b service nova] Releasing lock "refresh_cache-921ee52c-1551-4ec1-ae8b-3af43ae32c05" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6084a7c-475f-4d7a-87c0-8db15a83cb19]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e2f2f-bf3a-4006-9225-af09fe117541]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:04:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:45 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:04:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f620c3-da51-4ee0-924b-2758d3b89d04]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:04:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-0c9f68a4-fbcd-4fd4-a1cb-565a273bb9a3 req-b7647e78-6871-4f05-b6ad-d95a0f246881 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0c9f68a4-fbcd-4fd4-a1cb-565a273bb9a3 req-b7647e78-6871-4f05-b6ad-d95a0f246881 service nova] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0c9f68a4-fbcd-4fd4-a1cb-565a273bb9a3 req-b7647e78-6871-4f05-b6ad-d95a0f246881 service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0c9f68a4-fbcd-4fd4-a1cb-565a273bb9a3 req-b7647e78-6871-4f05-b6ad-d95a0f246881 service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-0c9f68a4-fbcd-4fd4-a1cb-565a273bb9a3 req-b7647e78-6871-4f05-b6ad-d95a0f246881 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] No waiting events found dispatching network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:46 user nova-compute[72793]: WARNING nova.compute.manager [req-0c9f68a4-fbcd-4fd4-a1cb-565a273bb9a3 req-b7647e78-6871-4f05-b6ad-d95a0f246881 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received unexpected event network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f for instance with vm_state building and task_state spawning.
Aug 17 04:04:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23237383536373463', 'path': '/dev/sdh'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237383536373463', 'path': '/dev/sdh'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780488707',display_name='tempest-ServerActionsTestOtherA-server-321540172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-780488707',id=15,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVutA9Tlf0owhQuLQZK0QoDbulIgKPSwUdDttRITsXkGjWxHg/0URF8DFUdn+qiNuqMEbrZXqZbm7X9YC2/nPRdYJorxhdjSfVjua8acZNIGbvmKrQsrL6l9UwIXtnvUQ==',key_name='tempest-keypair-169977143',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-d0ga5een',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=ecbd6261-7b55-4225-97c8-bbd02b37aa5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:04:46 user nova-compute[72793]:   <uuid>ecbd6261-7b55-4225-97c8-bbd02b37aa5a</uuid>
Aug 17 04:04:46 user nova-compute[72793]:   <name>instance-0000000f</name>
Aug 17 04:04:46 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:04:46 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:04:46 user nova-compute[72793]:   <metadata>
Aug 17 04:04:46 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:04:46 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:04:46 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherA-server-321540172</nova:name>
Aug 17 04:04:46 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:04:45</nova:creationTime>
Aug 17 04:04:46 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:04:46 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:04:46 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:04:46 user nova-compute[72793]:       <nova:owner>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:user uuid="65891e5eae334ee38675df619856db02">tempest-ServerActionsTestOtherA-1498578162-project-member</nova:user>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:project uuid="8c6b688c6c95499ab90009d73f378a92">tempest-ServerActionsTestOtherA-1498578162</nova:project>
Aug 17 04:04:46 user nova-compute[72793]:       </nova:owner>
Aug 17 04:04:46 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:04:46 user nova-compute[72793]:       <nova:ports>
Aug 17 04:04:46 user nova-compute[72793]:         <nova:port uuid="4d8d064e-ed85-494d-a8aa-c53b4f37ecfa">
Aug 17 04:04:46 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:04:46 user nova-compute[72793]:         </nova:port>
Aug 17 04:04:46 user nova-compute[72793]:       </nova:ports>
Aug 17 04:04:46 user nova-compute[72793]:     </nova:instance>
Aug 17 04:04:46 user nova-compute[72793]:   </metadata>
Aug 17 04:04:46 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:04:46 user nova-compute[72793]:     <system>
Aug 17 04:04:46 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:04:46 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:04:46 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:04:46 user nova-compute[72793]:       <entry name="serial">ecbd6261-7b55-4225-97c8-bbd02b37aa5a</entry>
Aug 17 04:04:46 user nova-compute[72793]:       <entry name="uuid">ecbd6261-7b55-4225-97c8-bbd02b37aa5a</entry>
Aug 17 04:04:46 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:04:46 user nova-compute[72793]:     </system>
Aug 17 04:04:46 user nova-compute[72793]:   </sysinfo>
Aug 17 04:04:46 user nova-compute[72793]:   <os>
Aug 17 04:04:46 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:04:46 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:04:46 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:04:46 user nova-compute[72793]:   </os>
Aug 17 04:04:46 user nova-compute[72793]:   <features>
Aug 17 04:04:46 user nova-compute[72793]:     <acpi/>
Aug 17 04:04:46 user nova-compute[72793]:     <apic/>
Aug 17 04:04:46 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:04:46 user nova-compute[72793]:   </features>
Aug 17 04:04:46 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:04:46 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:04:46 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:04:46 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:04:46 user nova-compute[72793]:   </clock>
Aug 17 04:04:46 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:04:46 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:04:46 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:04:46 user nova-compute[72793]:   </cpu>
Aug 17 04:04:46 user nova-compute[72793]:   <devices>
Aug 17 04:04:46 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:04:46 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:04:46 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk"/>
Aug 17 04:04:46 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:04:46 user nova-compute[72793]:     </disk>
Aug 17 04:04:46 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:04:46 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:04:46 user nova-compute[72793]:       <source dev="/dev/sdh"/>
Aug 17 04:04:46 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:04:46 user nova-compute[72793]:       <serial>908b6760-985b-4839-ad93-9e0f44af5afd</serial>
Aug 17 04:04:46 user nova-compute[72793]:     </disk>
Aug 17 04:04:46 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:04:46 user nova-compute[72793]:       <mac address="fa:16:3e:a9:49:e1"/>
Aug 17 04:04:46 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:46 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:04:46 user nova-compute[72793]:       <target dev="tap4d8d064e-ed"/>
Aug 17 04:04:46 user nova-compute[72793]:     </interface>
Aug 17 04:04:46 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:04:46 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/console.log" append="off"/>
Aug 17 04:04:46 user nova-compute[72793]:     </serial>
Aug 17 04:04:46 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:04:46 user nova-compute[72793]:     <video>
Aug 17 04:04:46 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:04:46 user nova-compute[72793]:     </video>
Aug 17 04:04:46 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:04:46 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:04:46 user nova-compute[72793]:     </rng>
Aug 17 04:04:46 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:04:46 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:04:46 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:04:46 user nova-compute[72793]:     </memballoon>
Aug 17 04:04:46 user nova-compute[72793]:   </devices>
Aug 17 04:04:46 user nova-compute[72793]: </domain>
Aug 17 04:04:46 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780488707',display_name='tempest-ServerActionsTestOtherA-server-321540172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-780488707',id=15,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVutA9Tlf0owhQuLQZK0QoDbulIgKPSwUdDttRITsXkGjWxHg/0URF8DFUdn+qiNuqMEbrZXqZbm7X9YC2/nPRdYJorxhdjSfVjua8acZNIGbvmKrQsrL6l9UwIXtnvUQ==',key_name='tempest-keypair-169977143',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-d0ga5een',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=ecbd6261-7b55-4225-97c8-bbd02b37aa5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG os_vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d8d064e-ed, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d8d064e-ed, col_values=(('external_ids', {'iface-id': '4d8d064e-ed85-494d-a8aa-c53b4f37ecfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:49:e1', 'vm-uuid': 'ecbd6261-7b55-4225-97c8-bbd02b37aa5a'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: INFO os_vif [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed')
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No VIF found with MAC fa:16:3e:a9:49:e1, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-efc239f0-9f8f-45c3-82b2-e4fdf0d46bc1 req-93691fde-5857-40e7-88ec-fecd25739092 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-efc239f0-9f8f-45c3-82b2-e4fdf0d46bc1 req-93691fde-5857-40e7-88ec-fecd25739092 service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-efc239f0-9f8f-45c3-82b2-e4fdf0d46bc1 req-93691fde-5857-40e7-88ec-fecd25739092 service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-efc239f0-9f8f-45c3-82b2-e4fdf0d46bc1 req-93691fde-5857-40e7-88ec-fecd25739092 service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-efc239f0-9f8f-45c3-82b2-e4fdf0d46bc1 req-93691fde-5857-40e7-88ec-fecd25739092 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:48 user nova-compute[72793]: WARNING nova.compute.manager [req-efc239f0-9f8f-45c3-82b2-e4fdf0d46bc1 req-93691fde-5857-40e7-88ec-fecd25739092 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state active and task_state rebuild_spawning.
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-4927f09c-8ca5-4f0f-a237-556288abacba req-2e1418e1-3ddc-4a92-83c4-de6ab9b5a3ba service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4927f09c-8ca5-4f0f-a237-556288abacba req-2e1418e1-3ddc-4a92-83c4-de6ab9b5a3ba service nova] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4927f09c-8ca5-4f0f-a237-556288abacba req-2e1418e1-3ddc-4a92-83c4-de6ab9b5a3ba service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4927f09c-8ca5-4f0f-a237-556288abacba req-2e1418e1-3ddc-4a92-83c4-de6ab9b5a3ba service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-4927f09c-8ca5-4f0f-a237-556288abacba req-2e1418e1-3ddc-4a92-83c4-de6ab9b5a3ba service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] No waiting events found dispatching network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:48 user nova-compute[72793]: WARNING nova.compute.manager [req-4927f09c-8ca5-4f0f-a237-556288abacba req-2e1418e1-3ddc-4a92-83c4-de6ab9b5a3ba service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received unexpected event network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f for instance with vm_state building and task_state spawning.
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245088.644494, 921ee52c-1551-4ec1-ae8b-3af43ae32c05 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] VM Resumed (Lifecycle Event)
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Instance spawned successfully.
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245088.6447296, 921ee52c-1551-4ec1-ae8b-3af43ae32c05 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] VM Started (Lifecycle Event)
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Took 6.91 seconds to spawn the instance on the hypervisor.
Aug 17 04:04:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:48 user nova-compute[72793]: INFO nova.compute.manager [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Took 7.82 seconds to build instance.
Aug 17 04:04:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4cae72c-7307-4bf0-a6c3-fe215b7db6cb tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.929s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-9946f3ca-ea20-418c-bc97-92fbcc077df0 req-44de5f4f-e9e8-48fd-8b3f-ebd5edd9643e service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9946f3ca-ea20-418c-bc97-92fbcc077df0 req-44de5f4f-e9e8-48fd-8b3f-ebd5edd9643e service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9946f3ca-ea20-418c-bc97-92fbcc077df0 req-44de5f4f-e9e8-48fd-8b3f-ebd5edd9643e service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9946f3ca-ea20-418c-bc97-92fbcc077df0 req-44de5f4f-e9e8-48fd-8b3f-ebd5edd9643e service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-9946f3ca-ea20-418c-bc97-92fbcc077df0 req-44de5f4f-e9e8-48fd-8b3f-ebd5edd9643e service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:04:50 user nova-compute[72793]: WARNING nova.compute.manager [req-9946f3ca-ea20-418c-bc97-92fbcc077df0 req-44de5f4f-e9e8-48fd-8b3f-ebd5edd9643e service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state active and task_state rebuild_spawning.
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245090.408317, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:50 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] VM Resumed (Lifecycle Event)
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:04:50 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance spawned successfully.
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:04:50 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245090.410091, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:04:50 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] VM Started (Lifecycle Event)
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:04:50 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72793) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 04:04:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ec566fac-3d2c-40c1-b9a5-d3b3ca977c15 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:04:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Creating image(s)
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Ensure instance console log exists: /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Start _get_guest_xml network_info=[{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3b38fd0-f823-4a39-927a-52c064339731', 'attached_at': '', 'detached_at': '', 'volume_id': '946c2324-0195-43b5-a447-a0daf9fd48ac', 'serial': '946c2324-0195-43b5-a447-a0daf9fd48ac'}, 'guest_format': None, 'attachment_id': 'a82c651d-85fb-4159-91b6-77990eb28d1d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:04:58 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:58 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:04:58 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:58 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:04:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:04:58 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[01003672-99e5-4854-a71d-59132db08e17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:04:58 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb5b4e-f80d-4fc4-9d08-98bc3f42ad16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac] added
Aug 17 04:04:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1171eb35-c0b3-4016-9f56-643a56e3cc82]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45c92c-ba1f-4249-b2e2-11ff84956b11]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpMrbDmO {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpMrbDmO" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe263659-d2fe-4a11-8673-5b1235983258]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpMrbDmO'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70b520c-6427-4bfd-94b2-c4b171a13f6e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a31a67-2823-4c97-a5be-02ec80844a24]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:04:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:04:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e734b0-a163-41a7-9e2f-e348c3f3bbdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260]
Aug 17 04:04:59 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260] successful.
Aug 17 04:04:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac97923b-4fda-4808-a897-9d625a0c6ad9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c222922-5493-4c59-859f-d0fb332d123a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:04:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:04:59 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:04:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] HCTL ('40', '-', '-', 0) found on session 28 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d69927-07ff-43cc-848c-c9baf785ac19]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching for a device in session 28 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:04:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23761326537376262', 'path': '/dev/sdi'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761326537376262', 'path': '/dev/sdi'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652282228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652282228',id=21,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-dw1fyjjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:39Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=d3b38fd0-f823-4a39-927a-52c064339731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'pci_devices' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:05:00 user nova-compute[72793]:   <uuid>d3b38fd0-f823-4a39-927a-52c064339731</uuid>
Aug 17 04:05:00 user nova-compute[72793]:   <name>instance-00000015</name>
Aug 17 04:05:00 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:05:00 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:05:00 user nova-compute[72793]:   <metadata>
Aug 17 04:05:00 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:05:00 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:05:00 user nova-compute[72793]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1652282228</nova:name>
Aug 17 04:05:00 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:04:58</nova:creationTime>
Aug 17 04:05:00 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:05:00 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:05:00 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:05:00 user nova-compute[72793]:       <nova:owner>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:user uuid="21663e2118004c528a64a7fba2e29ee3">tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member</nova:user>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:project uuid="a1ec39bbf61f45c6963f018159dcb33c">tempest-ServerBootFromVolumeStableRescueTest-1752371327</nova:project>
Aug 17 04:05:00 user nova-compute[72793]:       </nova:owner>
Aug 17 04:05:00 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:05:00 user nova-compute[72793]:       <nova:ports>
Aug 17 04:05:00 user nova-compute[72793]:         <nova:port uuid="1d296636-0862-4eb8-b813-29eeba5b6cd5">
Aug 17 04:05:00 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:05:00 user nova-compute[72793]:         </nova:port>
Aug 17 04:05:00 user nova-compute[72793]:       </nova:ports>
Aug 17 04:05:00 user nova-compute[72793]:     </nova:instance>
Aug 17 04:05:00 user nova-compute[72793]:   </metadata>
Aug 17 04:05:00 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:05:00 user nova-compute[72793]:     <system>
Aug 17 04:05:00 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:05:00 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:05:00 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:05:00 user nova-compute[72793]:       <entry name="serial">d3b38fd0-f823-4a39-927a-52c064339731</entry>
Aug 17 04:05:00 user nova-compute[72793]:       <entry name="uuid">d3b38fd0-f823-4a39-927a-52c064339731</entry>
Aug 17 04:05:00 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:05:00 user nova-compute[72793]:     </system>
Aug 17 04:05:00 user nova-compute[72793]:   </sysinfo>
Aug 17 04:05:00 user nova-compute[72793]:   <os>
Aug 17 04:05:00 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:05:00 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:05:00 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:05:00 user nova-compute[72793]:   </os>
Aug 17 04:05:00 user nova-compute[72793]:   <features>
Aug 17 04:05:00 user nova-compute[72793]:     <acpi/>
Aug 17 04:05:00 user nova-compute[72793]:     <apic/>
Aug 17 04:05:00 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:05:00 user nova-compute[72793]:   </features>
Aug 17 04:05:00 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:05:00 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:05:00 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:05:00 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:05:00 user nova-compute[72793]:   </clock>
Aug 17 04:05:00 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:05:00 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:05:00 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:05:00 user nova-compute[72793]:   </cpu>
Aug 17 04:05:00 user nova-compute[72793]:   <devices>
Aug 17 04:05:00 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:05:00 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:05:00 user nova-compute[72793]:       <source dev="/dev/sdi"/>
Aug 17 04:05:00 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:05:00 user nova-compute[72793]:       <serial>946c2324-0195-43b5-a447-a0daf9fd48ac</serial>
Aug 17 04:05:00 user nova-compute[72793]:     </disk>
Aug 17 04:05:00 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:05:00 user nova-compute[72793]:       <mac address="fa:16:3e:7d:d0:9c"/>
Aug 17 04:05:00 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:00 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:05:00 user nova-compute[72793]:       <target dev="tap1d296636-08"/>
Aug 17 04:05:00 user nova-compute[72793]:     </interface>
Aug 17 04:05:00 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:05:00 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/console.log" append="off"/>
Aug 17 04:05:00 user nova-compute[72793]:     </serial>
Aug 17 04:05:00 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:05:00 user nova-compute[72793]:     <video>
Aug 17 04:05:00 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:00 user nova-compute[72793]:     </video>
Aug 17 04:05:00 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:05:00 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:05:00 user nova-compute[72793]:     </rng>
Aug 17 04:05:00 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:05:00 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:05:00 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:05:00 user nova-compute[72793]:     </memballoon>
Aug 17 04:05:00 user nova-compute[72793]:   </devices>
Aug 17 04:05:00 user nova-compute[72793]: </domain>
Aug 17 04:05:00 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652282228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652282228',id=21,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-dw1fyjjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:04:39Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=d3b38fd0-f823-4a39-927a-52c064339731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG os_vif [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d296636-08, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d296636-08, col_values=(('external_ids', {'iface-id': '1d296636-0862-4eb8-b813-29eeba5b6cd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:d0:9c', 'vm-uuid': 'd3b38fd0-f823-4a39-927a-52c064339731'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:00 user nova-compute[72793]: INFO os_vif [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08')
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No VIF found with MAC fa:16:3e:7d:d0:9c, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:05:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-b10e36ff-1352-4107-a9f6-6b8b95384b0c req-afac5fc9-71c4-484a-8a0e-4254f9a7d76c service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b10e36ff-1352-4107-a9f6-6b8b95384b0c req-afac5fc9-71c4-484a-8a0e-4254f9a7d76c service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b10e36ff-1352-4107-a9f6-6b8b95384b0c req-afac5fc9-71c4-484a-8a0e-4254f9a7d76c service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b10e36ff-1352-4107-a9f6-6b8b95384b0c req-afac5fc9-71c4-484a-8a0e-4254f9a7d76c service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-b10e36ff-1352-4107-a9f6-6b8b95384b0c req-afac5fc9-71c4-484a-8a0e-4254f9a7d76c service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:02 user nova-compute[72793]: WARNING nova.compute.manager [req-b10e36ff-1352-4107-a9f6-6b8b95384b0c req-afac5fc9-71c4-484a-8a0e-4254f9a7d76c service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state building and task_state spawning.
Aug 17 04:05:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:02 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-5ce5e4da-a26f-498c-9512-6349d0b2921a req-db5102e4-047b-49d4-a2aa-c180f96afe5f service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5ce5e4da-a26f-498c-9512-6349d0b2921a req-db5102e4-047b-49d4-a2aa-c180f96afe5f service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5ce5e4da-a26f-498c-9512-6349d0b2921a req-db5102e4-047b-49d4-a2aa-c180f96afe5f service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5ce5e4da-a26f-498c-9512-6349d0b2921a req-db5102e4-047b-49d4-a2aa-c180f96afe5f service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-5ce5e4da-a26f-498c-9512-6349d0b2921a req-db5102e4-047b-49d4-a2aa-c180f96afe5f service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:04 user nova-compute[72793]: WARNING nova.compute.manager [req-5ce5e4da-a26f-498c-9512-6349d0b2921a req-db5102e4-047b-49d4-a2aa-c180f96afe5f service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state building and task_state spawning.
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245104.4642506, d3b38fd0-f823-4a39-927a-52c064339731 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Resumed (Lifecycle Event)
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance spawned successfully.
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245104.46817, d3b38fd0-f823-4a39-927a-52c064339731 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Started (Lifecycle Event)
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 17 04:05:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:04 user nova-compute[72793]: INFO nova.compute.manager [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Took 26.38 seconds to build instance.
Aug 17 04:05:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ea8a88f1-40f0-4174-97e4-b6f4c5e9ae6a tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "d3b38fd0-f823-4a39-927a-52c064339731" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.516s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:05:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:10 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:10 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=6993MB free_disk=25.572017669677734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 245698d6-2693-404a-b365-e17fc5665259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 07328c90-993b-4b0c-8673-04c850aae29c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 0caea72b-8769-4feb-ac34-5904ba45308f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 921ee52c-1551-4ec1-ae8b-3af43ae32c05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:05:10 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:05:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:05:16 user nova-compute[72793]: INFO nova.compute.claims [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Claim successful on node user
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:05:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.policy [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbad450f600b4d0aac294be4cd145fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba66a3ba645414983fd9fa888e734c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:05:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Creating image(s)
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:05:17 user nova-compute[72793]: INFO nova.compute.claims [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Claim successful on node user
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.205s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.234s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk 1073741824" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Successfully created port: 1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Cannot resize image /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'migration_context' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Ensure instance console log exists: /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:17 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:05:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:05:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Creating image(s)
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.249s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.policy [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbad450f600b4d0aac294be4cd145fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba66a3ba645414983fd9fa888e734c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.218s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk 1073741824" returned: 0 in 0.051s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Successfully updated port: 1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-changed-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Refreshing instance network info cache due to event network-changed-1c674004-09d6-41ac-8e81-57fbc1c33254. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] Acquiring lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Successfully created port: 4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Cannot resize image /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'migration_context' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Ensure instance console log exists: /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance network_info: |[{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] Acquired lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Refreshing network info cache for port 1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Start _get_guest_xml network_info=[{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:05:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126366052',display_name='tempest-ServerRescueNegativeTestJSON-server-126366052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126366052',id=23,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-vbayucpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:17Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=fc597951-d11b-4e35-8ee5-1f35c14c37eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'pci_devices' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:05:19 user nova-compute[72793]:   <uuid>fc597951-d11b-4e35-8ee5-1f35c14c37eb</uuid>
Aug 17 04:05:19 user nova-compute[72793]:   <name>instance-00000017</name>
Aug 17 04:05:19 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:05:19 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:05:19 user nova-compute[72793]:   <metadata>
Aug 17 04:05:19 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:05:19 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:05:19 user nova-compute[72793]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-126366052</nova:name>
Aug 17 04:05:19 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:05:19</nova:creationTime>
Aug 17 04:05:19 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:05:19 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:05:19 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:05:19 user nova-compute[72793]:       <nova:owner>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:user uuid="cbad450f600b4d0aac294be4cd145fa5">tempest-ServerRescueNegativeTestJSON-1617582959-project-member</nova:user>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:project uuid="fba66a3ba645414983fd9fa888e734c9">tempest-ServerRescueNegativeTestJSON-1617582959</nova:project>
Aug 17 04:05:19 user nova-compute[72793]:       </nova:owner>
Aug 17 04:05:19 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:05:19 user nova-compute[72793]:       <nova:ports>
Aug 17 04:05:19 user nova-compute[72793]:         <nova:port uuid="1c674004-09d6-41ac-8e81-57fbc1c33254">
Aug 17 04:05:19 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 04:05:19 user nova-compute[72793]:         </nova:port>
Aug 17 04:05:19 user nova-compute[72793]:       </nova:ports>
Aug 17 04:05:19 user nova-compute[72793]:     </nova:instance>
Aug 17 04:05:19 user nova-compute[72793]:   </metadata>
Aug 17 04:05:19 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:05:19 user nova-compute[72793]:     <system>
Aug 17 04:05:19 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:05:19 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:05:19 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:05:19 user nova-compute[72793]:       <entry name="serial">fc597951-d11b-4e35-8ee5-1f35c14c37eb</entry>
Aug 17 04:05:19 user nova-compute[72793]:       <entry name="uuid">fc597951-d11b-4e35-8ee5-1f35c14c37eb</entry>
Aug 17 04:05:19 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:05:19 user nova-compute[72793]:     </system>
Aug 17 04:05:19 user nova-compute[72793]:   </sysinfo>
Aug 17 04:05:19 user nova-compute[72793]:   <os>
Aug 17 04:05:19 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:05:19 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:05:19 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:05:19 user nova-compute[72793]:   </os>
Aug 17 04:05:19 user nova-compute[72793]:   <features>
Aug 17 04:05:19 user nova-compute[72793]:     <acpi/>
Aug 17 04:05:19 user nova-compute[72793]:     <apic/>
Aug 17 04:05:19 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:05:19 user nova-compute[72793]:   </features>
Aug 17 04:05:19 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:05:19 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:05:19 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:05:19 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:05:19 user nova-compute[72793]:   </clock>
Aug 17 04:05:19 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:05:19 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:05:19 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:05:19 user nova-compute[72793]:   </cpu>
Aug 17 04:05:19 user nova-compute[72793]:   <devices>
Aug 17 04:05:19 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:05:19 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:05:19 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk"/>
Aug 17 04:05:19 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:05:19 user nova-compute[72793]:     </disk>
Aug 17 04:05:19 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:05:19 user nova-compute[72793]:       <mac address="fa:16:3e:5c:37:bd"/>
Aug 17 04:05:19 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:19 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:05:19 user nova-compute[72793]:       <target dev="tap1c674004-09"/>
Aug 17 04:05:19 user nova-compute[72793]:     </interface>
Aug 17 04:05:19 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:05:19 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/console.log" append="off"/>
Aug 17 04:05:19 user nova-compute[72793]:     </serial>
Aug 17 04:05:19 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:05:19 user nova-compute[72793]:     <video>
Aug 17 04:05:19 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:19 user nova-compute[72793]:     </video>
Aug 17 04:05:19 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:05:19 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:05:19 user nova-compute[72793]:     </rng>
Aug 17 04:05:19 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:05:19 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:05:19 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:05:19 user nova-compute[72793]:     </memballoon>
Aug 17 04:05:19 user nova-compute[72793]:   </devices>
Aug 17 04:05:19 user nova-compute[72793]: </domain>
Aug 17 04:05:19 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126366052',display_name='tempest-ServerRescueNegativeTestJSON-server-126366052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126366052',id=23,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-vbayucpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:17Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=fc597951-d11b-4e35-8ee5-1f35c14c37eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG os_vif [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c674004-09, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c674004-09, col_values=(('external_ids', {'iface-id': '1c674004-09d6-41ac-8e81-57fbc1c33254', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:37:bd', 'vm-uuid': 'fc597951-d11b-4e35-8ee5-1f35c14c37eb'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:19 user nova-compute[72793]: INFO os_vif [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09')
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:5c:37:bd, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updated VIF entry in instance network info cache for port 1c674004-09d6-41ac-8e81-57fbc1c33254. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e56f87f5-0fac-4371-90c0-fb2cb67123ce req-e14dfc0b-c53d-4c7e-8c4e-0cc63de0dcb1 service nova] Releasing lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Successfully updated port: 4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-changed-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Refreshing instance network info cache due to event network-changed-4c4b5504-d88a-4921-8899-4c689002bd0d. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] Acquiring lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updating instance_info_cache with network_info: [{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance network_info: |[{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] Acquired lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.neutron [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Refreshing network info cache for port 4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Start _get_guest_xml network_info=[{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:05:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1885957072',display_name='tempest-ServerRescueNegativeTestJSON-server-1885957072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1885957072',id=24,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-8p7zlh0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:18Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=4491ef6b-8f7c-4360-bb15-448dd2959a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'pci_devices' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:05:20 user nova-compute[72793]:   <uuid>4491ef6b-8f7c-4360-bb15-448dd2959a99</uuid>
Aug 17 04:05:20 user nova-compute[72793]:   <name>instance-00000018</name>
Aug 17 04:05:20 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:05:20 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:05:20 user nova-compute[72793]:   <metadata>
Aug 17 04:05:20 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:05:20 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:05:20 user nova-compute[72793]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1885957072</nova:name>
Aug 17 04:05:20 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:05:20</nova:creationTime>
Aug 17 04:05:20 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:05:20 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:05:20 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:05:20 user nova-compute[72793]:       <nova:owner>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:user uuid="cbad450f600b4d0aac294be4cd145fa5">tempest-ServerRescueNegativeTestJSON-1617582959-project-member</nova:user>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:project uuid="fba66a3ba645414983fd9fa888e734c9">tempest-ServerRescueNegativeTestJSON-1617582959</nova:project>
Aug 17 04:05:20 user nova-compute[72793]:       </nova:owner>
Aug 17 04:05:20 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:05:20 user nova-compute[72793]:       <nova:ports>
Aug 17 04:05:20 user nova-compute[72793]:         <nova:port uuid="4c4b5504-d88a-4921-8899-4c689002bd0d">
Aug 17 04:05:20 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 04:05:20 user nova-compute[72793]:         </nova:port>
Aug 17 04:05:20 user nova-compute[72793]:       </nova:ports>
Aug 17 04:05:20 user nova-compute[72793]:     </nova:instance>
Aug 17 04:05:20 user nova-compute[72793]:   </metadata>
Aug 17 04:05:20 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:05:20 user nova-compute[72793]:     <system>
Aug 17 04:05:20 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:05:20 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:05:20 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:05:20 user nova-compute[72793]:       <entry name="serial">4491ef6b-8f7c-4360-bb15-448dd2959a99</entry>
Aug 17 04:05:20 user nova-compute[72793]:       <entry name="uuid">4491ef6b-8f7c-4360-bb15-448dd2959a99</entry>
Aug 17 04:05:20 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:05:20 user nova-compute[72793]:     </system>
Aug 17 04:05:20 user nova-compute[72793]:   </sysinfo>
Aug 17 04:05:20 user nova-compute[72793]:   <os>
Aug 17 04:05:20 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:05:20 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:05:20 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:05:20 user nova-compute[72793]:   </os>
Aug 17 04:05:20 user nova-compute[72793]:   <features>
Aug 17 04:05:20 user nova-compute[72793]:     <acpi/>
Aug 17 04:05:20 user nova-compute[72793]:     <apic/>
Aug 17 04:05:20 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:05:20 user nova-compute[72793]:   </features>
Aug 17 04:05:20 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:05:20 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:05:20 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:05:20 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:05:20 user nova-compute[72793]:   </clock>
Aug 17 04:05:20 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:05:20 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:05:20 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:05:20 user nova-compute[72793]:   </cpu>
Aug 17 04:05:20 user nova-compute[72793]:   <devices>
Aug 17 04:05:20 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:05:20 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:05:20 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk"/>
Aug 17 04:05:20 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:05:20 user nova-compute[72793]:     </disk>
Aug 17 04:05:20 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:05:20 user nova-compute[72793]:       <mac address="fa:16:3e:e3:86:44"/>
Aug 17 04:05:20 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:20 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:05:20 user nova-compute[72793]:       <target dev="tap4c4b5504-d8"/>
Aug 17 04:05:20 user nova-compute[72793]:     </interface>
Aug 17 04:05:20 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:05:20 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/console.log" append="off"/>
Aug 17 04:05:20 user nova-compute[72793]:     </serial>
Aug 17 04:05:20 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:05:20 user nova-compute[72793]:     <video>
Aug 17 04:05:20 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:20 user nova-compute[72793]:     </video>
Aug 17 04:05:20 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:05:20 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:05:20 user nova-compute[72793]:     </rng>
Aug 17 04:05:20 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:05:20 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:05:20 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:05:20 user nova-compute[72793]:     </memballoon>
Aug 17 04:05:20 user nova-compute[72793]:   </devices>
Aug 17 04:05:20 user nova-compute[72793]: </domain>
Aug 17 04:05:20 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1885957072',display_name='tempest-ServerRescueNegativeTestJSON-server-1885957072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1885957072',id=24,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-8p7zlh0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:18Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=4491ef6b-8f7c-4360-bb15-448dd2959a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG os_vif [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c4b5504-d8, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c4b5504-d8, col_values=(('external_ids', {'iface-id': '4c4b5504-d88a-4921-8899-4c689002bd0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:86:44', 'vm-uuid': '4491ef6b-8f7c-4360-bb15-448dd2959a99'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: INFO os_vif [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8')
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:e3:86:44, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.neutron [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updated VIF entry in instance network info cache for port 4c4b5504-d88a-4921-8899-4c689002bd0d. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.network.neutron [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updating instance_info_cache with network_info: [{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3deb40ad-c675-4060-b179-d20e69b8a13d req-631b55ff-7c84-4472-9fe5-12707b0cb83f service nova] Releasing lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-74f5a8c0-3b33-4578-a48d-71ea0a05115a req-face8eb9-865b-43c4-8a7b-f1036afea6df service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-74f5a8c0-3b33-4578-a48d-71ea0a05115a req-face8eb9-865b-43c4-8a7b-f1036afea6df service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-74f5a8c0-3b33-4578-a48d-71ea0a05115a req-face8eb9-865b-43c4-8a7b-f1036afea6df service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-74f5a8c0-3b33-4578-a48d-71ea0a05115a req-face8eb9-865b-43c4-8a7b-f1036afea6df service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-74f5a8c0-3b33-4578-a48d-71ea0a05115a req-face8eb9-865b-43c4-8a7b-f1036afea6df service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:20 user nova-compute[72793]: WARNING nova.compute.manager [req-74f5a8c0-3b33-4578-a48d-71ea0a05115a req-face8eb9-865b-43c4-8a7b-f1036afea6df service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state building and task_state spawning.
Aug 17 04:05:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:22 user nova-compute[72793]: WARNING nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state building and task_state spawning.
Aug 17 04:05:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:22 user nova-compute[72793]: WARNING nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state building and task_state spawning.
Aug 17 04:05:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:22 user nova-compute[72793]: WARNING nova.compute.manager [req-82033a8a-99c5-4768-b58f-7bcea7b296b1 req-c58a0b23-10be-4fd6-a433-75f793155821 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state building and task_state spawning.
Aug 17 04:05:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:23 user nova-compute[72793]: INFO nova.compute.manager [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Detaching volume 743584db-d218-4613-bf09-cc2bbd95731e
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.virt.block_device [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Attempting to driver detach volume 743584db-d218-4613-bf09-cc2bbd95731e from mountpoint /dev/vdb
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Attempting to detach device vdb from instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:05:24 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:05:24 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:05:24 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:05:24 user nova-compute[72793]:   <serial>743584db-d218-4613-bf09-cc2bbd95731e</serial>
Aug 17 04:05:24 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:05:24 user nova-compute[72793]: </disk>
Aug 17 04:05:24 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully detached device vdb from instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c from the persistent domain config.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:05:24 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:05:24 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:05:24 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:05:24 user nova-compute[72793]:   <serial>743584db-d218-4613-bf09-cc2bbd95731e</serial>
Aug 17 04:05:24 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:05:24 user nova-compute[72793]: </disk>
Aug 17 04:05:24 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245124.28441, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Resumed (Lifecycle Event)
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance spawned successfully.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245124.2847111, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Started (Lifecycle Event)
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Took 8.50 seconds to build instance.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0d6bfc4-28e1-4cc9-9427-d619d1a0995c tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.622s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245124.5550983, bc92c36f-acd0-417c-b8fd-8be00f5daa3c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245124.5605605, 4491ef6b-8f7c-4360-bb15-448dd2959a99 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] VM Resumed (Lifecycle Event)
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully detached device vdb from instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c from the live domain config.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbNpweIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:05:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance spawned successfully.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aefcd19-1f8a-4beb-8a4a-d8f33dd18c74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245124.5625782, 4491ef6b-8f7c-4360-bb15-448dd2959a99 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] VM Started (Lifecycle Event)
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0913ffd2-986f-4b70-a523-34bf6b31e3f9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:24 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02f6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[639d4e03-1683-4dca-9757-c9aa33d99d20]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92323bd-0fa7-4e6d-810e-c098bf42daa1]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.103s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[571c7579-38c5-4eec-b87d-c3d83d78b8b6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: INFO nova.compute.manager [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Took 7.87 seconds to build instance.
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad4f69c-76a6-42e5-acdc-e3a25f7b7c62]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a589fc99-8056-431a-81c9-9035eae27d36 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.066s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec03cc-b313-4338-816b-cb3e2c649753]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0853f1-c38f-446a-b41e-7aeb6a1d7974]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260]
Aug 17 04:05:24 user nova-compute[72793]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e, portal: 172.16.0.220,3260] successful.
Aug 17 04:05:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c31cf-abb8-4a14-b6ea-7b2e91bcbf82]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== disconnect_volume: return (439ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'flavor' on Instance uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e7549f44-ef77-4f52-94d9-6c373f8b6844 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.035s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.919s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:25 user nova-compute[72793]: INFO nova.compute.manager [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Terminating instance
Aug 17 04:05:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc5bad55-17a4-41dc-9f6c-6d09f38fb732 req-74bbe8fa-651d-4786-b393-0668318c316d service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-unplugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc5bad55-17a4-41dc-9f6c-6d09f38fb732 req-74bbe8fa-651d-4786-b393-0668318c316d service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc5bad55-17a4-41dc-9f6c-6d09f38fb732 req-74bbe8fa-651d-4786-b393-0668318c316d service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dc5bad55-17a4-41dc-9f6c-6d09f38fb732 req-74bbe8fa-651d-4786-b393-0668318c316d service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc5bad55-17a4-41dc-9f6c-6d09f38fb732 req-74bbe8fa-651d-4786-b393-0668318c316d service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-unplugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-dc5bad55-17a4-41dc-9f6c-6d09f38fb732 req-74bbe8fa-651d-4786-b393-0668318c316d service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-unplugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Instance destroyed successfully.
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'resources' on Instance uuid bc92c36f-acd0-417c-b8fd-8be00f5daa3c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1830791366',display_name='tempest-VolumesSnapshotTestJSON-instance-1830791366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1830791366',id=17,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIe6PMnGfB0S37233odrUTW9674R4yZxseoFp1CUng0kvsEwiX9GnnO9qxv4lewbQjSqZmO1o06BmO6WR5EzCe8DCpsiHbVIOZZzM5sULxlKLCIA99nIfBwyCjdYOedbQ==',key_name='tempest-keypair-653829853',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:02:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bee286a962408b835f909f54ed13c1',ramdisk_id='',reservation_id='r-s73vy4vf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1354726728',owner_user_name='tempest-VolumesSnapshotTestJSON-1354726728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab04a3f7b5a49a18611842d9b17caee',uuid=bc92c36f-acd0-417c-b8fd-8be00f5daa3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converting VIF {"id": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "address": "fa:16:3e:2d:06:fb", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a85a7d-fd", "ovs_interfaceid": "e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_vif [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a85a7d-fd, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:26 user nova-compute[72793]: INFO os_vif [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:06:fb,bridge_name='br-int',has_traffic_filtering=True,id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a85a7d-fd')
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WbNpweIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:05:26 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:743584db-d218-4613-bf09-cc2bbd95731e', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b797d845-ba69-4a40-8302-1e621f4ef1bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[998df425-1650-4951-80a6-45e1281d1eed]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:26 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:26 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:26 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0155750>, {}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Disconnecting from: [] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.102s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== disconnect_volume: return (116ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:05:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:05:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Deleting instance files /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c_del
Aug 17 04:05:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Deletion of /opt/stack/data/nova/instances/bc92c36f-acd0-417c-b8fd-8be00f5daa3c_del complete
Aug 17 04:05:27 user nova-compute[72793]: INFO nova.compute.manager [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 17 04:05:27 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-6f10cf1f-0987-41f8-8a20-e84b6ecb2052 req-d104a1eb-ed34-4be3-bef4-db9496f7fd0a service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-deleted-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:28 user nova-compute[72793]: INFO nova.compute.manager [req-6f10cf1f-0987-41f8-8a20-e84b6ecb2052 req-d104a1eb-ed34-4be3-bef4-db9496f7fd0a service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Neutron deleted interface e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76; detaching it from the instance and deleting it from the info cache
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.network.neutron [req-6f10cf1f-0987-41f8-8a20-e84b6ecb2052 req-d104a1eb-ed34-4be3-bef4-db9496f7fd0a service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:28 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Took 1.18 seconds to deallocate network for instance.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-6f10cf1f-0987-41f8-8a20-e84b6ecb2052 req-d104a1eb-ed34-4be3-bef4-db9496f7fd0a service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Detach interface failed, port_id=e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76, reason: Instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:05:28 user nova-compute[72793]: WARNING nova.volume.cinder [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Attachment 84c40d71-54a6-45f5-a309-5e9e48b3880a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 84c40d71-54a6-45f5-a309-5e9e48b3880a. (HTTP 404) (Request-ID: req-d8cd4c9e-84ea-4bbc-9547-6416ff869a29)
Aug 17 04:05:28 user nova-compute[72793]: INFO nova.compute.manager [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Took 0.02 seconds to detach 1 volumes for instance.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:28 user nova-compute[72793]: WARNING nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state deleted and task_state None.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:28 user nova-compute[72793]: WARNING nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state deleted and task_state None.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:28 user nova-compute[72793]: WARNING nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state deleted and task_state None.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-unplugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-unplugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:28 user nova-compute[72793]: WARNING nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-unplugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state deleted and task_state None.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Acquiring lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] No waiting events found dispatching network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:28 user nova-compute[72793]: WARNING nova.compute.manager [req-07124b7b-b5db-415a-aa2e-cde91a0695cf req-a6d4e951-a80b-41f3-8d73-de6dc14e382e service nova] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Received unexpected event network-vif-plugged-e1a85a7d-fd7d-43fa-8ee7-2ad3bcb20d76 for instance with vm_state deleted and task_state None.
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:28 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Deleted allocations for instance bc92c36f-acd0-417c-b8fd-8be00f5daa3c
Aug 17 04:05:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c4d69e78-9d99-469e-afec-423d89bc936b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "bc92c36f-acd0-417c-b8fd-8be00f5daa3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.996s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing instance network info cache due to event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG nova.network.neutron [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG nova.network.neutron [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updated VIF entry in instance network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG nova.network.neutron [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7bffff43-ffe0-4263-916b-cefe8a833218 req-96e31414-8b26-42ac-b7fe-ae8ba32cd37e service nova] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:41 user nova-compute[72793]: INFO nova.compute.manager [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Shelving
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance destroyed successfully.
Aug 17 04:05:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Beginning cold snapshot process
Aug 17 04:05:41 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245126.7758396, bc92c36f-acd0-417c-b8fd-8be00f5daa3c => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:41 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] VM Stopped (Lifecycle Event)
Aug 17 04:05:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ddaf171b-5fe0-4b0b-b6f6-ef5f0868f192 None None] [instance: bc92c36f-acd0-417c-b8fd-8be00f5daa3c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:05:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk /opt/stack/data/nova/instances/snapshots/tmpnetcxmrk/84c911da4e72415090e003b0ab564324 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk /opt/stack/data/nova/instances/snapshots/tmpnetcxmrk/84c911da4e72415090e003b0ab564324" returned: 0 in 0.717s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:42 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Snapshot extracted, beginning image upload
Aug 17 04:05:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Snapshot image upload complete
Aug 17 04:05:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:45 user nova-compute[72793]: INFO nova.compute.manager [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Shelve offloading
Aug 17 04:05:45 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance destroyed successfully.
Aug 17 04:05:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-9a13309e-efb8-443d-8e52-0e8499b7a537 req-7d80e174-b4e4-464d-a204-604d160a5852 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-unplugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9a13309e-efb8-443d-8e52-0e8499b7a537 req-7d80e174-b4e4-464d-a204-604d160a5852 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9a13309e-efb8-443d-8e52-0e8499b7a537 req-7d80e174-b4e4-464d-a204-604d160a5852 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9a13309e-efb8-443d-8e52-0e8499b7a537 req-7d80e174-b4e4-464d-a204-604d160a5852 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-9a13309e-efb8-443d-8e52-0e8499b7a537 req-7d80e174-b4e4-464d-a204-604d160a5852 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-unplugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:45 user nova-compute[72793]: WARNING nova.compute.manager [req-9a13309e-efb8-443d-8e52-0e8499b7a537 req-7d80e174-b4e4-464d-a204-604d160a5852 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-unplugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state shelved and task_state shelving_offloading.
Aug 17 04:05:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-changed-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing instance network info cache due to event network-changed-c2671b4e-a6e4-46d2-88f8-6441507b41b5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] Acquiring lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] Acquired lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Refreshing network info cache for port c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:05:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance destroyed successfully.
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'resources' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1507473122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1507473122',id=19,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrYpNqboEd0ERFKC5NS2ZIfTQfDZHRIFefcipuw+YBUg4ZM66mkSJgdM3pq8bkcMf+QrOE0d8rVnKiHxFsp6JC+nCOfBD7Y7xqpQdS1+iE15vnQG3i002oyVkZi95XEwQ==',key_name='tempest-keypair-208159808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-ndrldmu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member',shelved_at='2023-08-17T04:05:44.946301',shelved_host='user',shelved_image_id='f5a104bd-51e3-4326-bb69-353b46e69c39'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=0caea72b-8769-4feb-ac34-5904ba45308f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG os_vif [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing instance network info cache due to event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d7ebec7-8e, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:47 user nova-compute[72793]: INFO os_vif [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e')
Aug 17 04:05:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Deleting instance files /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f_del
Aug 17 04:05:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Deletion of /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f_del complete
Aug 17 04:05:47 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Deleted allocations for instance 0caea72b-8769-4feb-ac34-5904ba45308f
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'numa_topology' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updated VIF entry in instance network info cache for port c2671b4e-a6e4-46d2-88f8-6441507b41b5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-292fd1a8-73a6-4580-88cf-f0ab90cf5d2d req-d396c723-4276-4015-bb0d-918bc5514d44 service nova] Releasing lock "refresh_cache-dd0181a5-64af-4df2-854e-4703c76fd6e7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-26d79749-63a0-4709-9f46-46dc9b0ba8b4 req-97f253ed-047e-46a7-a9fc-94d6223e2c79 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-26d79749-63a0-4709-9f46-46dc9b0ba8b4 req-97f253ed-047e-46a7-a9fc-94d6223e2c79 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-26d79749-63a0-4709-9f46-46dc9b0ba8b4 req-97f253ed-047e-46a7-a9fc-94d6223e2c79 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-26d79749-63a0-4709-9f46-46dc9b0ba8b4 req-97f253ed-047e-46a7-a9fc-94d6223e2c79 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-26d79749-63a0-4709-9f46-46dc9b0ba8b4 req-97f253ed-047e-46a7-a9fc-94d6223e2c79 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:47 user nova-compute[72793]: WARNING nova.compute.manager [req-26d79749-63a0-4709-9f46-46dc9b0ba8b4 req-97f253ed-047e-46a7-a9fc-94d6223e2c79 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state shelved_offloaded and task_state None.
Aug 17 04:05:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4457f8a3-b865-4eee-b6fd-72e29702f1fc tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.172s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updated VIF entry in instance network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-306498bc-d270-4a9a-9544-ccb836316942 req-de22055d-3194-4852-9cfe-e515729ccf4b service nova] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:49 user nova-compute[72793]: INFO nova.compute.manager [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Terminating instance
Aug 17 04:05:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-da91871c-1a7d-425e-9241-6b9f65bc4f56 req-5596dd5a-15fd-424c-b99a-444401a13165 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da91871c-1a7d-425e-9241-6b9f65bc4f56 req-5596dd5a-15fd-424c-b99a-444401a13165 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da91871c-1a7d-425e-9241-6b9f65bc4f56 req-5596dd5a-15fd-424c-b99a-444401a13165 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da91871c-1a7d-425e-9241-6b9f65bc4f56 req-5596dd5a-15fd-424c-b99a-444401a13165 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-da91871c-1a7d-425e-9241-6b9f65bc4f56 req-5596dd5a-15fd-424c-b99a-444401a13165 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-da91871c-1a7d-425e-9241-6b9f65bc4f56 req-5596dd5a-15fd-424c-b99a-444401a13165 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-d757fa86-7150-47f4-8e71-a39529de76be req-dc7a242e-17a4-4c04-aab3-bc559116e219 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d757fa86-7150-47f4-8e71-a39529de76be req-dc7a242e-17a4-4c04-aab3-bc559116e219 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d757fa86-7150-47f4-8e71-a39529de76be req-dc7a242e-17a4-4c04-aab3-bc559116e219 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d757fa86-7150-47f4-8e71-a39529de76be req-dc7a242e-17a4-4c04-aab3-bc559116e219 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-d757fa86-7150-47f4-8e71-a39529de76be req-dc7a242e-17a4-4c04-aab3-bc559116e219 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-d757fa86-7150-47f4-8e71-a39529de76be req-dc7a242e-17a4-4c04-aab3-bc559116e219 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-831eb634-f3a3-4e63-89e5-54b481de69e7 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Instance destroyed successfully.
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.objects.instance [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lazy-loading 'resources' on Instance uuid dd0181a5-64af-4df2-854e-4703c76fd6e7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2671b4e-a6, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:82:e2,bridge_name='br-int',has_traffic_filtering=True,id=c2671b4e-a6e4-46d2-88f8-6441507b41b5,network=Network(d23b0fcf-fae4-4e1e-a814-6c740439b5c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2671b4e-a6')
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap831eb634-f3, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:10:48,bridge_name='br-int',has_traffic_filtering=True,id=831eb634-f3a3-4e63-89e5-54b481de69e7,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap831eb634-f3')
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59341503-95, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:9c:12,bridge_name='br-int',has_traffic_filtering=True,id=59341503-9546-4ede-810c-a4e75084eeb6,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap59341503-95')
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "address": "fa:16:3e:1d:87:4b", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2031f963-6a", "ovs_interfaceid": "2031f963-6ab5-4fe8-b423-8f4cef9ee9b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2031f963-6a, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:87:4b,bridge_name='br-int',has_traffic_filtering=True,id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2031f963-6a')
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98580878-b0, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:44:68,bridge_name='br-int',has_traffic_filtering=True,id=98580878-b000-4d2f-a896-7e2470e9af62,network=Network(3d089fab-c5b7-462a-8789-3a0e0125e68b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98580878-b0')
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b615dba-5e, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:b1:26,bridge_name='br-int',has_traffic_filtering=True,id=6b615dba-5e5b-4ef9-9110-b1babcb22539,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b615dba-5e')
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T04:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961871553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961871553',id=18,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQ/msIRmZSymSZ/6RkEOb8Juc6tzLt1Lv7NHxXYIOH4fLxUXUd0oceoDSoTZTlVZ5L2XluOn5LU0wKiQvTv6bF/gq7leRRtYfX7NPJ6lbagDULA4ClVwH3ded3A/Luoqw==',key_name='tempest-keypair-1604841537',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='116148bcb3af453983d87c6e9275d92c',ramdisk_id='',reservation_id='r-ak743b9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1912027053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1912027053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='228663705d3d4379984c1e0ce148ee96',uuid=dd0181a5-64af-4df2-854e-4703c76fd6e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converting VIF {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb92bfd5c-f3, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:51 user nova-compute[72793]: INFO os_vif [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c4:37,bridge_name='br-int',has_traffic_filtering=True,id=b92bfd5c-f326-47d3-b825-af2d680b8078,network=Network(805770e3-7fd3-4762-b5f3-141221946917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92bfd5c-f3')
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwRuxdlb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc828eb-d5b2-4265-b5d6-176cf2e23671]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce62b7-d964-4f6b-ad5b-2dc146fe4f5c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07caf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d'): ({'sdd'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Removing single pathed devices sdd {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30946ab6-f7e5-4049-b0ba-c4c325398c07]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb0eba-b8b0-4ad1-a85b-5a37193d280d]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Flushing IO for device /dev/sdd {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[794d96c0-e382-4b8b-97d6-bb9b4f8f23b2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96bfa82-c22a-4658-902a-fa57890dff61]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae3ad02-28e9-4905-89e8-0e0f00006ff0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-c2671b4e-a6e4-46d2-88f8-6441507b41b5 for instance with vm_state active and task_state deleting.
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-59341503-9546-4ede-810c-a4e75084eeb6 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING nova.compute.manager [req-0a1e9203-9b2c-44c0-bebf-9de644aefce0 req-ce3066f5-33c6-45a2-ae34-9b829baaed73 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-59341503-9546-4ede-810c-a4e75084eeb6 for instance with vm_state active and task_state deleting.
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[19021bd8-28a7-40ac-adcc-4fa72b72e3ec]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260]
Aug 17 04:05:52 user nova-compute[72793]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d, portal: 172.16.0.220,3260] successful.
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49dc4f36-f4bf-4008-995f-7b0f1c9c755d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a2c0e-7d3c-47d7-892a-ccf12517e61c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== disconnect_volume: return (349ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzVapvOY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2b47f-fa86-4e0a-8d56-2d1b310ecbcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd145ee-64b1-467b-8aee-81c63f458e74]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07caf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230'): ({'sdf'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Removing single pathed devices sdf {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6243d-9fd0-4507-a0e3-7dcd5994c4f9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f61bfbf-5a22-4ee0-9fe5-834e1ef645d4]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Flushing IO for device /dev/sdf {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[015fefcd-78dc-4b05-83d4-2f442cf500f6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1196ec77-9e63-4734-b1ca-c66309e0cecb]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] SCSI volumes sdf have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e2156-96c2-45c4-90d2-70fe6a3c44c6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4481fdae-e786-4b32-93de-a213cbd3c30a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260]
Aug 17 04:05:52 user nova-compute[72793]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230, portal: 172.16.0.220,3260] successful.
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa192701-fc9e-4df7-b12c-e0434337a230 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d07378a-18f6-4f63-8452-1879616e5948]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== disconnect_volume: return (331ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkjtRAVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8a079-29a6-4812-b642-ebaf6b336919]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c07b46e-4c89-4bf9-b534-8f07da2960a1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:05:52 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07caf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb'): ({'sdg'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Removing single pathed devices sdg {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3a7858-e8a4-4c6e-bc77-a6baf5cff2a4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[693adfe2-f0c7-4993-9917-01b369a12191]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Flushing IO for device /dev/sdg {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9a5714-7221-4639-a011-23675ebced6d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0567d-7012-4931-93fc-460cc43b9b40]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] SCSI volumes sdg have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae10ff-2cc4-4938-83dd-eb388e1ae7d6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-831eb634-f3a3-4e63-89e5-54b481de69e7 for instance with vm_state active and task_state deleting.
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-98580878-b000-4d2f-a896-7e2470e9af62 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-98580878-b000-4d2f-a896-7e2470e9af62 for instance with vm_state active and task_state deleting.
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:52 user nova-compute[72793]: WARNING nova.compute.manager [req-1fedd80b-96db-4ffc-8949-825ce129bd50 req-c826f037-2ada-49a7-a4e2-67998a9367dc service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-6b615dba-5e5b-4ef9-9110-b1babcb22539 for instance with vm_state active and task_state deleting.
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da5b373-7df5-40cc-8de4-63e84e3dfbb5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260]
Aug 17 04:05:52 user nova-compute[72793]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb, portal: 172.16.0.220,3260] successful.
Aug 17 04:05:52 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:05:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a96f7082-5584-4d3e-8cde-5e01383748eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfb697-d271-4c18-b6d7-2d3393a7bfd4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] <== disconnect_volume: return (321ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:05:53 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Deleting instance files /opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7_del
Aug 17 04:05:53 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Deletion of /opt/stack/data/nova/instances/dd0181a5-64af-4df2-854e-4703c76fd6e7_del complete
Aug 17 04:05:53 user nova-compute[72793]: INFO nova.compute.manager [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Took 3.24 seconds to destroy the instance on the hypervisor.
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:05:53 user nova-compute[72793]: INFO nova.compute.claims [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Claim successful on node user
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-31ab1714-a066-4c2b-88a4-53f64598a85e req-25481892-5f3e-46e3-adb5-6164cb5fdaf6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-31ab1714-a066-4c2b-88a4-53f64598a85e req-25481892-5f3e-46e3-adb5-6164cb5fdaf6 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-31ab1714-a066-4c2b-88a4-53f64598a85e req-25481892-5f3e-46e3-adb5-6164cb5fdaf6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-31ab1714-a066-4c2b-88a4-53f64598a85e req-25481892-5f3e-46e3-adb5-6164cb5fdaf6 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-31ab1714-a066-4c2b-88a4-53f64598a85e req-25481892-5f3e-46e3-adb5-6164cb5fdaf6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-31ab1714-a066-4c2b-88a4-53f64598a85e req-25481892-5f3e-46e3-adb5-6164cb5fdaf6 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:05:53 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.policy [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70ffd50546e64adeb74687cd0e03dab4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1748744bd54e4bda8621e8bae5595178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:05:53 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Creating image(s)
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "/opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "/opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "/opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.215s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk 1073741824" returned: 0 in 0.058s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Successfully created port: cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Cannot resize image /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'migration_context' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Ensure instance console log exists: /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Successfully updated port: cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquired lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:55 user nova-compute[72793]: WARNING nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 for instance with vm_state active and task_state deleting.
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-unplugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-unplugged-b92bfd5c-f326-47d3-b825-af2d680b8078 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Acquiring lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] No waiting events found dispatching network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:55 user nova-compute[72793]: WARNING nova.compute.manager [req-8b96aca2-030d-4505-b83c-1f7dbec973ff req-f89ccad8-986b-43cf-8ebe-5efdd3459705 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received unexpected event network-vif-plugged-b92bfd5c-f326-47d3-b825-af2d680b8078 for instance with vm_state active and task_state deleting.
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-changed-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Refreshing instance network info cache due to event network-changed-cc891a9e-5324-4a9f-9d12-930773b32e25. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] Acquiring lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updating instance_info_cache with network_info: [{"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Releasing lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Instance network_info: |[{"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] Acquired lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Refreshing network info cache for port cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Start _get_guest_xml network_info=[{"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:05:55 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:55 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1116381965',display_name='tempest-TestServerVolumeAttachmentScenario-server-1116381965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1116381965',id=25,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXQwAsfVNmiCHHb7v6JsAiXnjzgaJM4Y1qqp7cn3moh9hZ9gxGOMJTDYWnsMXed0xnueca5Z9G9DNx+eFVNT+ZQKi+EBzv0BZKXtvJbPhcEd1BfAJQ/SgSSUjHNWTbRzg==',key_name='tempest-keypair-685706486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1748744bd54e4bda8621e8bae5595178',ramdisk_id='',reservation_id='r-ia7ho10v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-450958633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-450958633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70ffd50546e64adeb74687cd0e03dab4',uuid=17cc3235-4e5d-41de-91ba-8cca63ba2585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Converting VIF {"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'pci_devices' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:05:55 user nova-compute[72793]:   <uuid>17cc3235-4e5d-41de-91ba-8cca63ba2585</uuid>
Aug 17 04:05:55 user nova-compute[72793]:   <name>instance-00000019</name>
Aug 17 04:05:55 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:05:55 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:05:55 user nova-compute[72793]:   <metadata>
Aug 17 04:05:55 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:05:55 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:05:55 user nova-compute[72793]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1116381965</nova:name>
Aug 17 04:05:55 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:05:55</nova:creationTime>
Aug 17 04:05:55 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:05:55 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:05:55 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:05:55 user nova-compute[72793]:       <nova:owner>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:user uuid="70ffd50546e64adeb74687cd0e03dab4">tempest-TestServerVolumeAttachmentScenario-450958633-project-member</nova:user>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:project uuid="1748744bd54e4bda8621e8bae5595178">tempest-TestServerVolumeAttachmentScenario-450958633</nova:project>
Aug 17 04:05:55 user nova-compute[72793]:       </nova:owner>
Aug 17 04:05:55 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:05:55 user nova-compute[72793]:       <nova:ports>
Aug 17 04:05:55 user nova-compute[72793]:         <nova:port uuid="cc891a9e-5324-4a9f-9d12-930773b32e25">
Aug 17 04:05:55 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:05:55 user nova-compute[72793]:         </nova:port>
Aug 17 04:05:55 user nova-compute[72793]:       </nova:ports>
Aug 17 04:05:55 user nova-compute[72793]:     </nova:instance>
Aug 17 04:05:55 user nova-compute[72793]:   </metadata>
Aug 17 04:05:55 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:05:55 user nova-compute[72793]:     <system>
Aug 17 04:05:55 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:05:55 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:05:55 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:05:55 user nova-compute[72793]:       <entry name="serial">17cc3235-4e5d-41de-91ba-8cca63ba2585</entry>
Aug 17 04:05:55 user nova-compute[72793]:       <entry name="uuid">17cc3235-4e5d-41de-91ba-8cca63ba2585</entry>
Aug 17 04:05:55 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:05:55 user nova-compute[72793]:     </system>
Aug 17 04:05:55 user nova-compute[72793]:   </sysinfo>
Aug 17 04:05:55 user nova-compute[72793]:   <os>
Aug 17 04:05:55 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:05:55 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:05:55 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:05:55 user nova-compute[72793]:   </os>
Aug 17 04:05:55 user nova-compute[72793]:   <features>
Aug 17 04:05:55 user nova-compute[72793]:     <acpi/>
Aug 17 04:05:55 user nova-compute[72793]:     <apic/>
Aug 17 04:05:55 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:05:55 user nova-compute[72793]:   </features>
Aug 17 04:05:55 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:05:55 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:05:55 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:05:55 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:05:55 user nova-compute[72793]:   </clock>
Aug 17 04:05:55 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:05:55 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:05:55 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:05:55 user nova-compute[72793]:   </cpu>
Aug 17 04:05:55 user nova-compute[72793]:   <devices>
Aug 17 04:05:55 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:05:55 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:05:55 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk"/>
Aug 17 04:05:55 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:05:55 user nova-compute[72793]:     </disk>
Aug 17 04:05:55 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:05:55 user nova-compute[72793]:       <mac address="fa:16:3e:00:57:30"/>
Aug 17 04:05:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:55 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:05:55 user nova-compute[72793]:       <target dev="tapcc891a9e-53"/>
Aug 17 04:05:55 user nova-compute[72793]:     </interface>
Aug 17 04:05:55 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:05:55 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/console.log" append="off"/>
Aug 17 04:05:55 user nova-compute[72793]:     </serial>
Aug 17 04:05:55 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:05:55 user nova-compute[72793]:     <video>
Aug 17 04:05:55 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:05:55 user nova-compute[72793]:     </video>
Aug 17 04:05:55 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:05:55 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:05:55 user nova-compute[72793]:     </rng>
Aug 17 04:05:55 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:05:55 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:05:55 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:05:55 user nova-compute[72793]:     </memballoon>
Aug 17 04:05:55 user nova-compute[72793]:   </devices>
Aug 17 04:05:55 user nova-compute[72793]: </domain>
Aug 17 04:05:55 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1116381965',display_name='tempest-TestServerVolumeAttachmentScenario-server-1116381965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1116381965',id=25,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXQwAsfVNmiCHHb7v6JsAiXnjzgaJM4Y1qqp7cn3moh9hZ9gxGOMJTDYWnsMXed0xnueca5Z9G9DNx+eFVNT+ZQKi+EBzv0BZKXtvJbPhcEd1BfAJQ/SgSSUjHNWTbRzg==',key_name='tempest-keypair-685706486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1748744bd54e4bda8621e8bae5595178',ramdisk_id='',reservation_id='r-ia7ho10v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-450958633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-450958633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70ffd50546e64adeb74687cd0e03dab4',uuid=17cc3235-4e5d-41de-91ba-8cca63ba2585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Converting VIF {"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG os_vif [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc891a9e-53, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc891a9e-53, col_values=(('external_ids', {'iface-id': 'cc891a9e-5324-4a9f-9d12-930773b32e25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:57:30', 'vm-uuid': '17cc3235-4e5d-41de-91ba-8cca63ba2585'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:55 user nova-compute[72793]: INFO os_vif [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53')
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:05:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No VIF found with MAC fa:16:3e:00:57:30, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:05:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updated VIF entry in instance network info cache for port cc891a9e-5324-4a9f-9d12-930773b32e25. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:05:56 user nova-compute[72793]: DEBUG nova.network.neutron [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updating instance_info_cache with network_info: [{"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6adf10ee-ba8d-43c7-b297-91614d70c1c6 req-c1df9b01-27f1-4589-9054-f7fb295df049 service nova] Releasing lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:05:56 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245141.6795578, 0caea72b-8769-4feb-ac34-5904ba45308f => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:56 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] VM Stopped (Lifecycle Event)
Aug 17 04:05:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-264a069f-b0e7-4350-a256-42e74ed2f778 None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-deleted-2031f963-6ab5-4fe8-b423-8f4cef9ee9b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:57 user nova-compute[72793]: INFO nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Neutron deleted interface 2031f963-6ab5-4fe8-b423-8f4cef9ee9b9; detaching it from the instance and deleting it from the info cache
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "address": "fa:16:3e:8e:82:e2", "network": {"id": "d23b0fcf-fae4-4e1e-a814-6c740439b5c6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1412634377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2671b4e-a6", "ovs_interfaceid": "c2671b4e-a6e4-46d2-88f8-6441507b41b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Detach interface failed, port_id=2031f963-6ab5-4fe8-b423-8f4cef9ee9b9, reason: Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-deleted-c2671b4e-a6e4-46d2-88f8-6441507b41b5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:57 user nova-compute[72793]: INFO nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Neutron deleted interface c2671b4e-a6e4-46d2-88f8-6441507b41b5; detaching it from the instance and deleting it from the info cache
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "address": "fa:16:3e:86:b1:26", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b615dba-5e", "ovs_interfaceid": "6b615dba-5e5b-4ef9-9110-b1babcb22539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-738d1374-d5cc-4ecf-9a88-9231883a88b8 req-2ec6ef2e-5961-4164-ab2b-1214cad24268 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-738d1374-d5cc-4ecf-9a88-9231883a88b8 req-2ec6ef2e-5961-4164-ab2b-1214cad24268 service nova] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-738d1374-d5cc-4ecf-9a88-9231883a88b8 req-2ec6ef2e-5961-4164-ab2b-1214cad24268 service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-738d1374-d5cc-4ecf-9a88-9231883a88b8 req-2ec6ef2e-5961-4164-ab2b-1214cad24268 service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-738d1374-d5cc-4ecf-9a88-9231883a88b8 req-2ec6ef2e-5961-4164-ab2b-1214cad24268 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] No waiting events found dispatching network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:57 user nova-compute[72793]: WARNING nova.compute.manager [req-738d1374-d5cc-4ecf-9a88-9231883a88b8 req-2ec6ef2e-5961-4164-ab2b-1214cad24268 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received unexpected event network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 for instance with vm_state building and task_state spawning.
Aug 17 04:05:57 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Took 4.40 seconds to deallocate network for instance.
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Detach interface failed, port_id=c2671b4e-a6e4-46d2-88f8-6441507b41b5, reason: Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-deleted-6b615dba-5e5b-4ef9-9110-b1babcb22539 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:57 user nova-compute[72793]: INFO nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Neutron deleted interface 6b615dba-5e5b-4ef9-9110-b1babcb22539; detaching it from the instance and deleting it from the info cache
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98580878-b000-4d2f-a896-7e2470e9af62", "address": "fa:16:3e:54:44:68", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98580878-b0", "ovs_interfaceid": "98580878-b000-4d2f-a896-7e2470e9af62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Detach interface failed, port_id=6b615dba-5e5b-4ef9-9110-b1babcb22539, reason: Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-deleted-98580878-b000-4d2f-a896-7e2470e9af62 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:57 user nova-compute[72793]: INFO nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Neutron deleted interface 98580878-b000-4d2f-a896-7e2470e9af62; detaching it from the instance and deleting it from the info cache
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92bfd5c-f326-47d3-b825-af2d680b8078", "address": "fa:16:3e:3c:c4:37", "network": {"id": "805770e3-7fd3-4762-b5f3-141221946917", "bridge": "br-int", "label": "tempest-device-tagging-net2-804023304", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92bfd5c-f3", "ovs_interfaceid": "b92bfd5c-f326-47d3-b825-af2d680b8078", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-773adbf3-3fcb-496c-96c8-a4d8e47feeb3 req-2cb811f6-2046-4e90-a958-cfd82e15bfd3 service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Detach interface failed, port_id=98580878-b000-4d2f-a896-7e2470e9af62, reason: Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-f0c5bf82-4319-45f5-857b-7f3909fbcad4 req-5b1b615e-3c99-4947-91df-51fd4b091dff service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Received event network-vif-deleted-b92bfd5c-f326-47d3-b825-af2d680b8078 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [req-f0c5bf82-4319-45f5-857b-7f3909fbcad4 req-5b1b615e-3c99-4947-91df-51fd4b091dff service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Neutron deleted interface b92bfd5c-f326-47d3-b825-af2d680b8078; detaching it from the instance and deleting it from the info cache
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.network.neutron [req-f0c5bf82-4319-45f5-857b-7f3909fbcad4 req-5b1b615e-3c99-4947-91df-51fd4b091dff service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Updating instance_info_cache with network_info: [{"id": "831eb634-f3a3-4e63-89e5-54b481de69e7", "address": "fa:16:3e:8e:10:48", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap831eb634-f3", "ovs_interfaceid": "831eb634-f3a3-4e63-89e5-54b481de69e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "59341503-9546-4ede-810c-a4e75084eeb6", "address": "fa:16:3e:3b:9c:12", "network": {"id": "3d089fab-c5b7-462a-8789-3a0e0125e68b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1788844466", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "116148bcb3af453983d87c6e9275d92c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59341503-95", "ovs_interfaceid": "59341503-9546-4ede-810c-a4e75084eeb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-f0c5bf82-4319-45f5-857b-7f3909fbcad4 req-5b1b615e-3c99-4947-91df-51fd4b091dff service nova] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Detach interface failed, port_id=b92bfd5c-f326-47d3-b825-af2d680b8078, reason: Instance dd0181a5-64af-4df2-854e-4703c76fd6e7 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245159.552847, 17cc3235-4e5d-41de-91ba-8cca63ba2585 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] VM Resumed (Lifecycle Event)
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-dca8674a-197b-440e-ae0a-3c4fa1557e30 req-44489c57-196f-4058-94c3-ceb8955b0689 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dca8674a-197b-440e-ae0a-3c4fa1557e30 req-44489c57-196f-4058-94c3-ceb8955b0689 service nova] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dca8674a-197b-440e-ae0a-3c4fa1557e30 req-44489c57-196f-4058-94c3-ceb8955b0689 service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dca8674a-197b-440e-ae0a-3c4fa1557e30 req-44489c57-196f-4058-94c3-ceb8955b0689 service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-dca8674a-197b-440e-ae0a-3c4fa1557e30 req-44489c57-196f-4058-94c3-ceb8955b0689 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] No waiting events found dispatching network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:05:59 user nova-compute[72793]: WARNING nova.compute.manager [req-dca8674a-197b-440e-ae0a-3c4fa1557e30 req-44489c57-196f-4058-94c3-ceb8955b0689 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received unexpected event network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 for instance with vm_state building and task_state spawning.
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Instance spawned successfully.
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245159.5578914, 17cc3235-4e5d-41de-91ba-8cca63ba2585 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] VM Started (Lifecycle Event)
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 17 04:05:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Took 6.74 seconds to build instance.
Aug 17 04:05:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c3a8ad49-9e73-42f5-9fd7-9526cac66d2f tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:05:59 user nova-compute[72793]: INFO nova.compute.manager [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Took 2.47 seconds to detach 3 volumes for instance.
Aug 17 04:06:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:00 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Deleted allocations for instance dd0181a5-64af-4df2-854e-4703c76fd6e7
Aug 17 04:06:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dcb20279-4b2c-4c02-81bd-96e6e956f112 tempest-TaggedBootDevicesTest_v242-1912027053 tempest-TaggedBootDevicesTest_v242-1912027053-project-member] Lock "dd0181a5-64af-4df2-854e-4703c76fd6e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.696s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:00 user nova-compute[72793]: INFO nova.compute.manager [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] instance snapshotting
Aug 17 04:06:01 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Beginning live snapshot process
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing instance network info cache due to event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxxu6ydb1/8c54fc6bb981467bbe881bb2abca1be4.delta 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxxu6ydb1/8c54fc6bb981467bbe881bb2abca1be4.delta 1073741824" returned: 0 in 0.047s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 04:06:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updated VIF entry in instance network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46af6488-0b12-44a1-8029-b0d67b82bc2f req-641df143-6917-48e3-a200-ccff47d6b49a service nova] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:02 user nova-compute[72793]: INFO nova.compute.manager [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Terminating instance
Aug 17 04:06:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:06:03 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxxu6ydb1/8c54fc6bb981467bbe881bb2abca1be4.delta /opt/stack/data/nova/instances/snapshots/tmpxxu6ydb1/8c54fc6bb981467bbe881bb2abca1be4 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-ae9de2e5-7325-4017-b597-0a49fb58b54e req-baf6310b-83b2-4f2a-8a5a-8cb8c38bca12 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ae9de2e5-7325-4017-b597-0a49fb58b54e req-baf6310b-83b2-4f2a-8a5a-8cb8c38bca12 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ae9de2e5-7325-4017-b597-0a49fb58b54e req-baf6310b-83b2-4f2a-8a5a-8cb8c38bca12 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ae9de2e5-7325-4017-b597-0a49fb58b54e req-baf6310b-83b2-4f2a-8a5a-8cb8c38bca12 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-ae9de2e5-7325-4017-b597-0a49fb58b54e req-baf6310b-83b2-4f2a-8a5a-8cb8c38bca12 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-ae9de2e5-7325-4017-b597-0a49fb58b54e req-baf6310b-83b2-4f2a-8a5a-8cb8c38bca12 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-unplugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:06:03 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Instance destroyed successfully.
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.objects.instance [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lazy-loading 'resources' on Instance uuid 07328c90-993b-4b0c-8673-04c850aae29c {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-276616593',display_name='tempest-ServerActionsTestOtherB-server-276616593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-276616593',id=2,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9JKKb3LkxAIaUpHUwAg7q6P2mA5cTYIKa+u2TtGTKBLvz7BGlT+uy+Qs9UiEWKfB+ltp/O59FN8jKGOSlf6qyx2E61MaZu7w9cLkLRQ0Wv4G6m6WzRHa5/02GR5WqKiQ==',key_name='tempest-keypair-808922084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b799dd936be46aab2513974c488ae92',ramdisk_id='',reservation_id='r-0wfyodzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1791175768',owner_user_name='tempest-ServerActionsTestOtherB-1791175768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad95533bd5634f7384f9c9f58a9aaf81',uuid=07328c90-993b-4b0c-8673-04c850aae29c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converting VIF {"id": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "address": "fa:16:3e:73:21:bf", "network": {"id": "d8ee8944-2cad-4a4a-9a52-51aeb3d690a7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-333557076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b799dd936be46aab2513974c488ae92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf0e2da-57", "ovs_interfaceid": "fcf0e2da-57d4-4b11-8d5d-4410979612d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG os_vif [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf0e2da-57, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:06:04 user nova-compute[72793]: INFO os_vif [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=fcf0e2da-57d4-4b11-8d5d-4410979612d7,network=Network(d8ee8944-2cad-4a4a-9a52-51aeb3d690a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf0e2da-57')
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iRcNjTIp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:06:04 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxxu6ydb1/8c54fc6bb981467bbe881bb2abca1be4.delta /opt/stack/data/nova/instances/snapshots/tmpxxu6ydb1/8c54fc6bb981467bbe881bb2abca1be4" returned: 0 in 0.612s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Snapshot extracted, beginning image upload
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[611338a7-0f09-4408-ac08-becb7bd644a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ef9659-1e8e-4210-8cbd-a88d3e94e2f8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:06:04 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:06:04 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:06:04 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:06:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 (non-flash)
Aug 17 04:06:04 user nova-compute[72793]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:06:04 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:06:04 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:06:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0155ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071'): ({'sde'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Removing single pathed devices sde {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22736da-874d-4bb4-9e16-ab76369cff31]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b4de1e-48a6-4a88-bb5e-cb31b289dff2]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Flushing IO for device /dev/sde {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c1152-5252-4183-bdbf-85cee511d141]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[071652b3-a489-4f75-a2fa-cafaf7d17a16]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a31b59-64c5-459a-967b-5b41754ff0b5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[403391f8-1fe8-41ad-bb2e-7d93235b399e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260]
Aug 17 04:06:04 user nova-compute[72793]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071, portal: 172.16.0.220,3260] successful.
Aug 17 04:06:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b7bb4ef-1973-40d0-994c-b13795372071 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b91a1-5b9f-4477-a8f9-f654d1059332]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] <== disconnect_volume: return (345ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:06:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Deleting instance files /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c_del
Aug 17 04:06:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Deletion of /opt/stack/data/nova/instances/07328c90-993b-4b0c-8673-04c850aae29c_del complete
Aug 17 04:06:04 user nova-compute[72793]: INFO nova.compute.manager [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Took 1.56 seconds to destroy the instance on the hypervisor.
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating instance_info_cache with network_info: [{"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-ecbd6261-7b55-4225-97c8-bbd02b37aa5a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] Acquiring lock "07328c90-993b-4b0c-8673-04c850aae29c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] Lock "07328c90-993b-4b0c-8673-04c850aae29c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] No waiting events found dispatching network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:05 user nova-compute[72793]: WARNING nova.compute.manager [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received unexpected event network-vif-plugged-fcf0e2da-57d4-4b11-8d5d-4410979612d7 for instance with vm_state active and task_state deleting.
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing instance network info cache due to event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:05 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Took 1.45 seconds to deallocate network for instance.
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-1dad7cf2-4e9b-4d42-b3db-4186c99dc271 req-d9cc1392-38f8-456e-9c35-872f36cdfd55 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Received event network-vif-deleted-fcf0e2da-57d4-4b11-8d5d-4410979612d7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:05 user nova-compute[72793]: INFO nova.compute.manager [req-1dad7cf2-4e9b-4d42-b3db-4186c99dc271 req-d9cc1392-38f8-456e-9c35-872f36cdfd55 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Neutron deleted interface fcf0e2da-57d4-4b11-8d5d-4410979612d7; detaching it from the instance and deleting it from the info cache
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-1dad7cf2-4e9b-4d42-b3db-4186c99dc271 req-d9cc1392-38f8-456e-9c35-872f36cdfd55 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing instance network info cache due to event network-changed-0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] Acquiring lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-1dad7cf2-4e9b-4d42-b3db-4186c99dc271 req-d9cc1392-38f8-456e-9c35-872f36cdfd55 service nova] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Detach interface failed, port_id=fcf0e2da-57d4-4b11-8d5d-4410979612d7, reason: Instance 07328c90-993b-4b0c-8673-04c850aae29c could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.compute.manager [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Detaching volume 5b1915cc-f648-4e44-9bd2-e3cea7728bbf
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.virt.block_device [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Attempting to driver detach volume 5b1915cc-f648-4e44-9bd2-e3cea7728bbf from mountpoint /dev/vdb
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Attempting to detach device vdb from instance 245698d6-2693-404a-b365-e17fc5665259 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:06:06 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:06:06 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:06:06 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:06:06 user nova-compute[72793]:   <serial>5b1915cc-f648-4e44-9bd2-e3cea7728bbf</serial>
Aug 17 04:06:06 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:06:06 user nova-compute[72793]: </disk>
Aug 17 04:06:06 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully detached device vdb from instance 245698d6-2693-404a-b365-e17fc5665259 from the persistent domain config.
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 245698d6-2693-404a-b365-e17fc5665259 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:06:06 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:06:06 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:06:06 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:06:06 user nova-compute[72793]:   <serial>5b1915cc-f648-4e44-9bd2-e3cea7728bbf</serial>
Aug 17 04:06:06 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:06:06 user nova-compute[72793]: </disk>
Aug 17 04:06:06 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updated VIF entry in instance network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ef0661ce-0cdc-49d5-bb70-ddbe7c7f9f97 req-7e707f47-d538-4e55-8499-1f8edf7399e9 service nova] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] Acquired lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Refreshing network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Snapshot image upload complete
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.compute.manager [None req-068dd464-8a47-4ce8-a441-b5d9662a9cda tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Took 5.69 seconds to snapshot the instance on the hypervisor.
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245151.6698363, dd0181a5-64af-4df2-854e-4703c76fd6e7 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] VM Stopped (Lifecycle Event)
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9801e23a-9651-4c32-ae61-387e0136054c None None] [instance: dd0181a5-64af-4df2-854e-4703c76fd6e7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245166.7323046, 245698d6-2693-404a-b365-e17fc5665259 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully detached device vdb from instance 245698d6-2693-404a-b365-e17fc5665259 from the live domain config.
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: INFO nova.compute.manager [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Took 0.89 seconds to detach 1 volumes for instance.
Aug 17 04:06:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ifnymzru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:06:06 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[547c31b9-2a88-440a-8d13-22b15afd5af3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b197a2-b9ff-461b-8f69-2279d63c256b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:06:06 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:06:06 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:06:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf (non-flash)
Aug 17 04:06:06 user nova-compute[72793]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:06:06 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:06:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02b9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba7951e-1fda-4235-8f1d-fa9dcdcfbc69]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e7a07c-394c-4425-b15f-35246c50bbf6]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b477c9-3a17-4ebd-afd3-b6440581ac6c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:06:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updated VIF entry in instance network info cache for port 0e78924b-74b3-4441-917d-1bd448b0a420. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [{"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d995d0d-3773-4263-a4c2-7ec28f8c44d3]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6625b947-08c0-4163-8419-2d0cdad2fc08 req-12abb8cb-fc83-448a-afd0-21989400c08b service nova] Releasing lock "refresh_cache-245698d6-2693-404a-b365-e17fc5665259" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[629a6ec6-1de3-4d7c-a648-1754706c1c04]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[056023e5-2899-407a-8c32-61479a961850]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260]
Aug 17 04:06:07 user nova-compute[72793]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf, portal: 172.16.0.220,3260] successful.
Aug 17 04:06:07 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b1915cc-f648-4e44-9bd2-e3cea7728bbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22437c4-cd1d-43c7-b4fd-e87f28451259]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] <== disconnect_volume: return (409ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.544s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:07 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Deleted allocations for instance 07328c90-993b-4b0c-8673-04c850aae29c
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9b216304-99cd-48d6-ad23-7fabd0c8a821 tempest-ServerActionsTestOtherB-1791175768 tempest-ServerActionsTestOtherB-1791175768-project-member] Lock "07328c90-993b-4b0c-8673-04c850aae29c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.678s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'flavor' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-753b6ece-d801-49a4-9d8b-4af9d88bb6d1 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.944s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:06:09 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:06:09 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7164MB free_disk=25.48404312133789GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 245698d6-2693-404a-b365-e17fc5665259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 921ee52c-1551-4ec1-ae8b-3af43ae32c05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:06:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:06:10 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:06:10 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:06:10 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:06:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:06:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:06:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:18 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245163.9378657, 07328c90-993b-4b0c-8673-04c850aae29c => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:18 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] VM Stopped (Lifecycle Event)
Aug 17 04:06:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be1496df-b29c-4b97-ae8d-6b4d1e28a4e0 None None] [instance: 07328c90-993b-4b0c-8673-04c850aae29c] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:29 user nova-compute[72793]: INFO nova.compute.manager [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Rescuing
Aug 17 04:06:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:29 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:06:29 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-558188a1-150d-4941-b40f-18b6f7edbaa8 req-263673e4-4afe-4cdc-a0ca-83017862491b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-558188a1-150d-4941-b40f-18b6f7edbaa8 req-263673e4-4afe-4cdc-a0ca-83017862491b service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-558188a1-150d-4941-b40f-18b6f7edbaa8 req-263673e4-4afe-4cdc-a0ca-83017862491b service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-558188a1-150d-4941-b40f-18b6f7edbaa8 req-263673e4-4afe-4cdc-a0ca-83017862491b service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-558188a1-150d-4941-b40f-18b6f7edbaa8 req-263673e4-4afe-4cdc-a0ca-83017862491b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:30 user nova-compute[72793]: WARNING nova.compute.manager [req-558188a1-150d-4941-b40f-18b6f7edbaa8 req-263673e4-4afe-4cdc-a0ca-83017862491b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state active and task_state rescuing.
Aug 17 04:06:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance destroyed successfully.
Aug 17 04:06:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Attempting a stable device rescue
Aug 17 04:06:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72793) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:06:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Creating image(s)
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "04657f02b81f36f3e18cf1db38bf3ef056e3e238" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "04657f02b81f36f3e18cf1db38bf3ef056e3e238" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:31 user nova-compute[72793]: INFO nova.compute.manager [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Terminating instance
Aug 17 04:06:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.part --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.virt.images [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] e7a4f766-8bdb-4965-a376-ba9c30b881bc was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.part /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-0311f577-5fc8-4f71-b3b2-68d1fd209222 req-8d40584e-a907-432e-be38-4982133580fd service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0311f577-5fc8-4f71-b3b2-68d1fd209222 req-8d40584e-a907-432e-be38-4982133580fd service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0311f577-5fc8-4f71-b3b2-68d1fd209222 req-8d40584e-a907-432e-be38-4982133580fd service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0311f577-5fc8-4f71-b3b2-68d1fd209222 req-8d40584e-a907-432e-be38-4982133580fd service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-0311f577-5fc8-4f71-b3b2-68d1fd209222 req-8d40584e-a907-432e-be38-4982133580fd service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:32 user nova-compute[72793]: WARNING nova.compute.manager [req-0311f577-5fc8-4f71-b3b2-68d1fd209222 req-8d40584e-a907-432e-be38-4982133580fd service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state active and task_state rescuing.
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-5f4eb8c8-7671-48b7-9d65-c664ca8ee6e4 req-4c9e68e4-13d2-4953-9fc5-8a2bfcaa3c62 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-vif-unplugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5f4eb8c8-7671-48b7-9d65-c664ca8ee6e4 req-4c9e68e4-13d2-4953-9fc5-8a2bfcaa3c62 service nova] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5f4eb8c8-7671-48b7-9d65-c664ca8ee6e4 req-4c9e68e4-13d2-4953-9fc5-8a2bfcaa3c62 service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5f4eb8c8-7671-48b7-9d65-c664ca8ee6e4 req-4c9e68e4-13d2-4953-9fc5-8a2bfcaa3c62 service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-5f4eb8c8-7671-48b7-9d65-c664ca8ee6e4 req-4c9e68e4-13d2-4953-9fc5-8a2bfcaa3c62 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] No waiting events found dispatching network-vif-unplugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-5f4eb8c8-7671-48b7-9d65-c664ca8ee6e4 req-4c9e68e4-13d2-4953-9fc5-8a2bfcaa3c62 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-vif-unplugged-4195b995-1168-4914-b1eb-ae7232ace35f for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.part /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.converted" returned: 0 in 0.423s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "04657f02b81f36f3e18cf1db38bf3ef056e3e238" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.116s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "04657f02b81f36f3e18cf1db38bf3ef056e3e238" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "04657f02b81f36f3e18cf1db38bf3ef056e3e238" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Instance destroyed successfully.
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lazy-loading 'resources' on Instance uuid 921ee52c-1551-4ec1-ae8b-3af43ae32c05 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1783971542',display_name='tempest-VolumesNegativeTest-instance-1783971542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1783971542',id=22,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c068775d4da4d489bdbcfa1a7505683',ramdisk_id='',reservation_id='r-a28vtm9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-492167290',owner_user_name='tempest-VolumesNegativeTest-492167290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:49Z,user_data=None,user_id='0d5ebd08ec8d46909028e890b4d1c142',uuid=921ee52c-1551-4ec1-ae8b-3af43ae32c05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Converting VIF {"id": "4195b995-1168-4914-b1eb-ae7232ace35f", "address": "fa:16:3e:a0:a0:84", "network": {"id": "78280492-6123-4711-9c23-ab0a3b4e4ccc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1cc711b057f64d01a027be757f962556", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4195b995-11", "ovs_interfaceid": "4195b995-1168-4914-b1eb-ae7232ace35f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG os_vif [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4195b995-11, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:32 user nova-compute[72793]: INFO os_vif [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:a0:84,bridge_name='br-int',has_traffic_filtering=True,id=4195b995-1168-4914-b1eb-ae7232ace35f,network=Network(78280492-6123-4711-9c23-ab0a3b4e4ccc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4195b995-11')
Aug 17 04:06:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Deleting instance files /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05_del
Aug 17 04:06:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Deletion of /opt/stack/data/nova/instances/921ee52c-1551-4ec1-ae8b-3af43ae32c05_del complete
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238 --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238,backing_fmt=raw /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238,backing_fmt=raw /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue" returned: 0 in 0.057s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "04657f02b81f36f3e18cf1db38bf3ef056e3e238" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'migration_context' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:32 user nova-compute[72793]: INFO nova.compute.manager [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 17 04:06:32 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Start _get_guest_xml network_info=[{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "vif_mac": "fa:16:3e:7d:d0:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e7a4f766-8bdb-4965-a376-ba9c30b881bc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'd3b38fd0-f823-4a39-927a-52c064339731', 'attached_at': '', 'detached_at': '', 'volume_id': '946c2324-0195-43b5-a447-a0daf9fd48ac', 'serial': '946c2324-0195-43b5-a447-a0daf9fd48ac'}, 'guest_format': None, 'attachment_id': 'a82c651d-85fb-4159-91b6-77990eb28d1d', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'resources' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'numa_topology' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:32 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:06:32 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:06:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:06:33 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:06:33 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:06:33 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d5be59-5c4c-4a09-8f9c-39b78db050fd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PpMrbDmO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 04:06:33 user nova-compute[72793]: node.name = iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac
Aug 17 04:06:33 user nova-compute[72793]: node.tpgt = -1
Aug 17 04:06:33 user nova-compute[72793]: node.startup = automatic
Aug 17 04:06:33 user nova-compute[72793]: node.leading_login = No
Aug 17 04:06:33 user nova-compute[72793]: iface.iscsi_ifacename = default
Aug 17 04:06:33 user nova-compute[72793]: iface.net_ifacename = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.ipaddress = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.prefix_len = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.hwaddress = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.transport_name = tcp
Aug 17 04:06:33 user nova-compute[72793]: iface.initiatorname = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.vlan_id = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.vlan_priority = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.vlan_state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.iface_num = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.mtu = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.port = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.bootproto = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.subnet_mask = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.gateway = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_alt_client_id = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_dns = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_learn_iqn = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_vendor_id_state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_vendor_id = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.dhcp_slp_da = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.fragmentation = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.gratuitous_arp = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.incoming_forwarding = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.tos_state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.tos = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.ttl = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.delayed_ack = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.tcp_nagle = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.tcp_wsf_state = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.tcp_wsf = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.tcp_timer_scale = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.tcp_timestamp = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.redirect = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.def_task_mgmt_timeout = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.header_digest = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.data_digest = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.immediate_data = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.initial_r2t = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.data_seq_inorder = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.data_pdu_inorder = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.erl = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.max_receive_data_len = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.first_burst_len = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.max_outstanding_r2t = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.max_burst_len = 0
Aug 17 04:06:33 user nova-compute[72793]: iface.chap_auth = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.bidi_chap = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.strict_login_compliance = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.discovery_auth = <empty>
Aug 17 04:06:33 user nova-compute[72793]: iface.discovery_logout = <empty>
Aug 17 04:06:33 user nova-compute[72793]: node.discovery_address = <empty>
Aug 17 04:06:33 user nova-compute[72793]: node.discovery_port = 0
Aug 17 04:06:33 user nova-compute[72793]: node.discovery_type = static
Aug 17 04:06:33 user nova-compute[72793]: node.session.initial_cmdsn = 0
Aug 17 04:06:33 user nova-compute[72793]: node.session.initial_login_retry_max = 8
Aug 17 04:06:33 user nova-compute[72793]: node.session.xmit_thread_priority = -20
Aug 17 04:06:33 user nova-compute[72793]: node.session.cmds_max = 128
Aug 17 04:06:33 user nova-compute[72793]: node.session.queue_depth = 32
Aug 17 04:06:33 user nova-compute[72793]: node.session.nr_sessions = 1
Aug 17 04:06:33 user nova-compute[72793]: node.session.auth.authmethod = CHAP
Aug 17 04:06:33 user nova-compute[72793]: node.session.auth.username = PpMrbDmO
Aug 17 04:06:33 user nova-compute[72793]: node.session.auth.password = ***
Aug 17 04:06:33 user nova-compute[72793]: node.session.auth.username_in = <empty>
Aug 17 04:06:33 user nova-compute[72793]: node.session.auth.password_in = <empty>
Aug 17 04:06:33 user nova-compute[72793]: node.session.auth.chap_algs = MD5
Aug 17 04:06:33 user nova-compute[72793]: node.session.timeo.replacement_timeout = 120
Aug 17 04:06:33 user nova-compute[72793]: node.session.err_timeo.abort_timeout = 15
Aug 17 04:06:33 user nova-compute[72793]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 04:06:33 user nova-compute[72793]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 04:06:33 user nova-compute[72793]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.FastAbort = Yes
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.InitialR2T = No
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.ImmediateData = Yes
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.MaxConnections = 1
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 04:06:33 user nova-compute[72793]: node.session.iscsi.ERL = 0
Aug 17 04:06:33 user nova-compute[72793]: node.session.scan = manual
Aug 17 04:06:33 user nova-compute[72793]: node.session.reopen_max = 0
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].address = 172.16.0.220
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].port = 3260
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].startup = manual
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].tcp.window_size = 524288
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].tcp.type_of_service = 0
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].timeo.logout_timeout = 15
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].timeo.login_timeout = 15
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].timeo.auth_timeout = 45
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].iscsi.DataDigest = None
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].iscsi.IFMarker = No
Aug 17 04:06:33 user nova-compute[72793]: node.conn[0].iscsi.OFMarker = No
Aug 17 04:06:33 user nova-compute[72793]: # END RECORD
Aug 17 04:06:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac224afb-474a-4634-b2b3-f7a9ec3f738a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f562195-8f1b-4e01-8922-6956018d9656]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpMrbDmO {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpMrbDmO" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[88feaed9-9841-4462-a5f3-116d56b2c3f2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpMrbDmO'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a49205-d037-4795-adaf-d5d2485cc66a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98fd3ad-1c23-4524-8bea-8f3f5e433880]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:06:33 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:06:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:06:33 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:06:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] HCTL ('40', '0', '0', 0) found on session 28 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Scanning host 40 c: 0, t: 0, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0afb5c-6518-418d-bee0-5646c64d7882]: (4, ('0 0 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching for a device in session 28 and hctl ('40', '0', '0', 0) yield: sdi {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23761326537376262', 'path': '/dev/sdi'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761326537376262', 'path': '/dev/sdi'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652282228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652282228',id=21,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:05:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-dw1fyjjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:05Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=d3b38fd0-f823-4a39-927a-52c064339731,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "vif_mac": "fa:16:3e:7d:d0:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "vif_mac": "fa:16:3e:7d:d0:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'pci_devices' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:06:33 user nova-compute[72793]:   <uuid>d3b38fd0-f823-4a39-927a-52c064339731</uuid>
Aug 17 04:06:33 user nova-compute[72793]:   <name>instance-00000015</name>
Aug 17 04:06:33 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:06:33 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:06:33 user nova-compute[72793]:   <metadata>
Aug 17 04:06:33 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:06:33 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:06:33 user nova-compute[72793]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1652282228</nova:name>
Aug 17 04:06:33 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:06:32</nova:creationTime>
Aug 17 04:06:33 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:06:33 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:06:33 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:06:33 user nova-compute[72793]:       <nova:owner>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:user uuid="21663e2118004c528a64a7fba2e29ee3">tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member</nova:user>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:project uuid="a1ec39bbf61f45c6963f018159dcb33c">tempest-ServerBootFromVolumeStableRescueTest-1752371327</nova:project>
Aug 17 04:06:33 user nova-compute[72793]:       </nova:owner>
Aug 17 04:06:33 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:06:33 user nova-compute[72793]:       <nova:ports>
Aug 17 04:06:33 user nova-compute[72793]:         <nova:port uuid="1d296636-0862-4eb8-b813-29eeba5b6cd5">
Aug 17 04:06:33 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:06:33 user nova-compute[72793]:         </nova:port>
Aug 17 04:06:33 user nova-compute[72793]:       </nova:ports>
Aug 17 04:06:33 user nova-compute[72793]:     </nova:instance>
Aug 17 04:06:33 user nova-compute[72793]:   </metadata>
Aug 17 04:06:33 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:06:33 user nova-compute[72793]:     <system>
Aug 17 04:06:33 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:06:33 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:06:33 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:06:33 user nova-compute[72793]:       <entry name="serial">d3b38fd0-f823-4a39-927a-52c064339731</entry>
Aug 17 04:06:33 user nova-compute[72793]:       <entry name="uuid">d3b38fd0-f823-4a39-927a-52c064339731</entry>
Aug 17 04:06:33 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:06:33 user nova-compute[72793]:     </system>
Aug 17 04:06:33 user nova-compute[72793]:   </sysinfo>
Aug 17 04:06:33 user nova-compute[72793]:   <os>
Aug 17 04:06:33 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:06:33 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:06:33 user nova-compute[72793]:   </os>
Aug 17 04:06:33 user nova-compute[72793]:   <features>
Aug 17 04:06:33 user nova-compute[72793]:     <acpi/>
Aug 17 04:06:33 user nova-compute[72793]:     <apic/>
Aug 17 04:06:33 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:06:33 user nova-compute[72793]:   </features>
Aug 17 04:06:33 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:06:33 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:06:33 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:06:33 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:06:33 user nova-compute[72793]:   </clock>
Aug 17 04:06:33 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:06:33 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:06:33 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:06:33 user nova-compute[72793]:   </cpu>
Aug 17 04:06:33 user nova-compute[72793]:   <devices>
Aug 17 04:06:33 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:06:33 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:06:33 user nova-compute[72793]:       <source dev="/dev/sdi"/>
Aug 17 04:06:33 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:06:33 user nova-compute[72793]:       <serial>946c2324-0195-43b5-a447-a0daf9fd48ac</serial>
Aug 17 04:06:33 user nova-compute[72793]:     </disk>
Aug 17 04:06:33 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:06:33 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:06:33 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue"/>
Aug 17 04:06:33 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:06:33 user nova-compute[72793]:       <boot order="1"/>
Aug 17 04:06:33 user nova-compute[72793]:     </disk>
Aug 17 04:06:33 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:06:33 user nova-compute[72793]:       <mac address="fa:16:3e:7d:d0:9c"/>
Aug 17 04:06:33 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:06:33 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:06:33 user nova-compute[72793]:       <target dev="tap1d296636-08"/>
Aug 17 04:06:33 user nova-compute[72793]:     </interface>
Aug 17 04:06:33 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:06:33 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/console.log" append="off"/>
Aug 17 04:06:33 user nova-compute[72793]:     </serial>
Aug 17 04:06:33 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:06:33 user nova-compute[72793]:     <video>
Aug 17 04:06:33 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:06:33 user nova-compute[72793]:     </video>
Aug 17 04:06:33 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:06:33 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:06:33 user nova-compute[72793]:     </rng>
Aug 17 04:06:33 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:06:33 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:06:33 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:06:33 user nova-compute[72793]:     </memballoon>
Aug 17 04:06:33 user nova-compute[72793]:   </devices>
Aug 17 04:06:33 user nova-compute[72793]: </domain>
Aug 17 04:06:33 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:06:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance destroyed successfully.
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No VIF found with MAC fa:16:3e:7d:d0:9c, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:33 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Took 0.90 seconds to deallocate network for instance.
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-8c00f8a9-dddb-47c3-93e3-4a8c37f5f923 req-1ae0def9-ccc6-4ef6-868c-8ffd907f46d4 service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-vif-deleted-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:34 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Deleted allocations for instance 921ee52c-1551-4ec1-ae8b-3af43ae32c05
Aug 17 04:06:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2ede2e61-0e1d-4c73-82e5-3814b149e865 tempest-VolumesNegativeTest-492167290 tempest-VolumesNegativeTest-492167290-project-member] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-f1b4bd51-5200-48da-af87-1cd92b500b62 req-982334a1-582c-4fe1-b92c-d6bdb5245efe service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received event network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f1b4bd51-5200-48da-af87-1cd92b500b62 req-982334a1-582c-4fe1-b92c-d6bdb5245efe service nova] Acquiring lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f1b4bd51-5200-48da-af87-1cd92b500b62 req-982334a1-582c-4fe1-b92c-d6bdb5245efe service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f1b4bd51-5200-48da-af87-1cd92b500b62 req-982334a1-582c-4fe1-b92c-d6bdb5245efe service nova] Lock "921ee52c-1551-4ec1-ae8b-3af43ae32c05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-f1b4bd51-5200-48da-af87-1cd92b500b62 req-982334a1-582c-4fe1-b92c-d6bdb5245efe service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] No waiting events found dispatching network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:34 user nova-compute[72793]: WARNING nova.compute.manager [req-f1b4bd51-5200-48da-af87-1cd92b500b62 req-982334a1-582c-4fe1-b92c-d6bdb5245efe service nova] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Received unexpected event network-vif-plugged-4195b995-1168-4914-b1eb-ae7232ace35f for instance with vm_state deleted and task_state None.
Aug 17 04:06:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:36 user nova-compute[72793]: WARNING nova.compute.manager [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state active and task_state rescuing.
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:36 user nova-compute[72793]: WARNING nova.compute.manager [req-b095523a-c80f-4bd0-b2ee-5bba29cce3ef req-48cb3ef1-0b26-49d4-8b9f-069c0d7fb21b service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state active and task_state rescuing.
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for d3b38fd0-f823-4a39-927a-52c064339731 due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245196.9675987, d3b38fd0-f823-4a39-927a-52c064339731 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:36 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Resumed (Lifecycle Event)
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cab46da8-68c4-4093-a72d-50a06f45d3ee tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:06:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 04:06:37 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245196.969168, d3b38fd0-f823-4a39-927a-52c064339731 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Started (Lifecycle Event)
Aug 17 04:06:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:06:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:06:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:06:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:06:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:06:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:06:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:47 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245192.6784902, 921ee52c-1551-4ec1-ae8b-3af43ae32c05 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:47 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] VM Stopped (Lifecycle Event)
Aug 17 04:06:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c35ef78-1959-48dc-9476-380a0190e1d0 None None] [instance: 921ee52c-1551-4ec1-ae8b-3af43ae32c05] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:06:48 user nova-compute[72793]: INFO nova.compute.claims [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Claim successful on node user
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:06:48 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.policy [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ab04a3f7b5a49a18611842d9b17caee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77bee286a962408b835f909f54ed13c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:06:48 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Creating image(s)
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "/opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "/opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk 1073741824" returned: 0 in 0.054s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Successfully created port: 135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Cannot resize image /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'migration_context' on Instance uuid 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Ensure instance console log exists: /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Successfully updated port: 135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquired lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-changed-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Refreshing instance network info cache due to event network-changed-135dd33e-b492-45d6-91c9-bdc9318edac4. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] Acquiring lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:06:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updating instance_info_cache with network_info: [{"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Releasing lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Instance network_info: |[{"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] Acquired lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Refreshing network info cache for port 135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Start _get_guest_xml network_info=[{"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:06:51 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:06:51 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2002050548',display_name='tempest-VolumesSnapshotTestJSON-instance-2002050548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2002050548',id=26,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRUR7ze9lq06kAXJmDC54BQk1ldVivBf6T2H1rb/vvolkJYREyXjppLpVyEuE19Y3+1cyMcwjSLgexdY0xVu5/14Dh59v1+NOaSK/PSi/wdB1GCcF1V3Nq2f+U23QHXyQ==',key_name='tempest-keypair-1570946757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bee286a962408b835f909f54ed13c1',ramdisk_id='',reservation_id='r-60ntqx1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1354726728',owner_user_name='tempest-VolumesSnapshotTestJSON-1354726728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab04a3f7b5a49a18611842d9b17caee',uuid=4eaa5595-c08e-48a3-a731-66b740d355ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converting VIF {"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:06:51 user nova-compute[72793]:   <uuid>4eaa5595-c08e-48a3-a731-66b740d355ab</uuid>
Aug 17 04:06:51 user nova-compute[72793]:   <name>instance-0000001a</name>
Aug 17 04:06:51 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:06:51 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:06:51 user nova-compute[72793]:   <metadata>
Aug 17 04:06:51 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:06:51 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:06:51 user nova-compute[72793]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2002050548</nova:name>
Aug 17 04:06:51 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:06:51</nova:creationTime>
Aug 17 04:06:51 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:06:51 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:06:51 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:06:51 user nova-compute[72793]:       <nova:owner>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:user uuid="3ab04a3f7b5a49a18611842d9b17caee">tempest-VolumesSnapshotTestJSON-1354726728-project-member</nova:user>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:project uuid="77bee286a962408b835f909f54ed13c1">tempest-VolumesSnapshotTestJSON-1354726728</nova:project>
Aug 17 04:06:51 user nova-compute[72793]:       </nova:owner>
Aug 17 04:06:51 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:06:51 user nova-compute[72793]:       <nova:ports>
Aug 17 04:06:51 user nova-compute[72793]:         <nova:port uuid="135dd33e-b492-45d6-91c9-bdc9318edac4">
Aug 17 04:06:51 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:06:51 user nova-compute[72793]:         </nova:port>
Aug 17 04:06:51 user nova-compute[72793]:       </nova:ports>
Aug 17 04:06:51 user nova-compute[72793]:     </nova:instance>
Aug 17 04:06:51 user nova-compute[72793]:   </metadata>
Aug 17 04:06:51 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:06:51 user nova-compute[72793]:     <system>
Aug 17 04:06:51 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:06:51 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:06:51 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:06:51 user nova-compute[72793]:       <entry name="serial">4eaa5595-c08e-48a3-a731-66b740d355ab</entry>
Aug 17 04:06:51 user nova-compute[72793]:       <entry name="uuid">4eaa5595-c08e-48a3-a731-66b740d355ab</entry>
Aug 17 04:06:51 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:06:51 user nova-compute[72793]:     </system>
Aug 17 04:06:51 user nova-compute[72793]:   </sysinfo>
Aug 17 04:06:51 user nova-compute[72793]:   <os>
Aug 17 04:06:51 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:06:51 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:06:51 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:06:51 user nova-compute[72793]:   </os>
Aug 17 04:06:51 user nova-compute[72793]:   <features>
Aug 17 04:06:51 user nova-compute[72793]:     <acpi/>
Aug 17 04:06:51 user nova-compute[72793]:     <apic/>
Aug 17 04:06:51 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:06:51 user nova-compute[72793]:   </features>
Aug 17 04:06:51 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:06:51 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:06:51 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:06:51 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:06:51 user nova-compute[72793]:   </clock>
Aug 17 04:06:51 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:06:51 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:06:51 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:06:51 user nova-compute[72793]:   </cpu>
Aug 17 04:06:51 user nova-compute[72793]:   <devices>
Aug 17 04:06:51 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:06:51 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:06:51 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk"/>
Aug 17 04:06:51 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:06:51 user nova-compute[72793]:     </disk>
Aug 17 04:06:51 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:06:51 user nova-compute[72793]:       <mac address="fa:16:3e:95:c3:42"/>
Aug 17 04:06:51 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:06:51 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:06:51 user nova-compute[72793]:       <target dev="tap135dd33e-b4"/>
Aug 17 04:06:51 user nova-compute[72793]:     </interface>
Aug 17 04:06:51 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:06:51 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/console.log" append="off"/>
Aug 17 04:06:51 user nova-compute[72793]:     </serial>
Aug 17 04:06:51 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:06:51 user nova-compute[72793]:     <video>
Aug 17 04:06:51 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:06:51 user nova-compute[72793]:     </video>
Aug 17 04:06:51 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:06:51 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:06:51 user nova-compute[72793]:     </rng>
Aug 17 04:06:51 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:06:51 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:06:51 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:06:51 user nova-compute[72793]:     </memballoon>
Aug 17 04:06:51 user nova-compute[72793]:   </devices>
Aug 17 04:06:51 user nova-compute[72793]: </domain>
Aug 17 04:06:51 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2002050548',display_name='tempest-VolumesSnapshotTestJSON-instance-2002050548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2002050548',id=26,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRUR7ze9lq06kAXJmDC54BQk1ldVivBf6T2H1rb/vvolkJYREyXjppLpVyEuE19Y3+1cyMcwjSLgexdY0xVu5/14Dh59v1+NOaSK/PSi/wdB1GCcF1V3Nq2f+U23QHXyQ==',key_name='tempest-keypair-1570946757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bee286a962408b835f909f54ed13c1',ramdisk_id='',reservation_id='r-60ntqx1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1354726728',owner_user_name='tempest-VolumesSnapshotTestJSON-1354726728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab04a3f7b5a49a18611842d9b17caee',uuid=4eaa5595-c08e-48a3-a731-66b740d355ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converting VIF {"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG os_vif [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap135dd33e-b4, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap135dd33e-b4, col_values=(('external_ids', {'iface-id': '135dd33e-b492-45d6-91c9-bdc9318edac4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:c3:42', 'vm-uuid': '4eaa5595-c08e-48a3-a731-66b740d355ab'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:51 user nova-compute[72793]: INFO os_vif [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4')
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No VIF found with MAC fa:16:3e:95:c3:42, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updated VIF entry in instance network info cache for port 135dd33e-b492-45d6-91c9-bdc9318edac4. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updating instance_info_cache with network_info: [{"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:06:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e409c0be-4a15-423e-85c0-14f2e3607f35 req-9357ca28-ceef-4f21-a5ed-644aa154730f service nova] Releasing lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:06:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-51336192-f633-4814-bc85-8c71efd0bc82 req-5ad4fb92-03f2-4159-92bf-da8c09e439d6 service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-51336192-f633-4814-bc85-8c71efd0bc82 req-5ad4fb92-03f2-4159-92bf-da8c09e439d6 service nova] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-51336192-f633-4814-bc85-8c71efd0bc82 req-5ad4fb92-03f2-4159-92bf-da8c09e439d6 service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-51336192-f633-4814-bc85-8c71efd0bc82 req-5ad4fb92-03f2-4159-92bf-da8c09e439d6 service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-51336192-f633-4814-bc85-8c71efd0bc82 req-5ad4fb92-03f2-4159-92bf-da8c09e439d6 service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] No waiting events found dispatching network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:53 user nova-compute[72793]: WARNING nova.compute.manager [req-51336192-f633-4814-bc85-8c71efd0bc82 req-5ad4fb92-03f2-4159-92bf-da8c09e439d6 service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received unexpected event network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 for instance with vm_state building and task_state spawning.
Aug 17 04:06:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245214.8465064, 4eaa5595-c08e-48a3-a731-66b740d355ab => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:54 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] VM Resumed (Lifecycle Event)
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:06:54 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Instance spawned successfully.
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:06:54 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245214.8488097, 4eaa5595-c08e-48a3-a731-66b740d355ab => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:06:54 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] VM Started (Lifecycle Event)
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:06:54 user nova-compute[72793]: INFO nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 17 04:06:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:06:54 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:06:55 user nova-compute[72793]: INFO nova.compute.manager [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Took 6.76 seconds to build instance.
Aug 17 04:06:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b43b565d-d4cd-43a4-997e-d1e6ffcd0b93 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.855s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-fc143d51-92f9-43ce-9257-1f7b6ecbd1f9 req-58416829-e8b4-46fc-8054-5a342a5bccab service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:06:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fc143d51-92f9-43ce-9257-1f7b6ecbd1f9 req-58416829-e8b4-46fc-8054-5a342a5bccab service nova] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:06:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fc143d51-92f9-43ce-9257-1f7b6ecbd1f9 req-58416829-e8b4-46fc-8054-5a342a5bccab service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:06:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fc143d51-92f9-43ce-9257-1f7b6ecbd1f9 req-58416829-e8b4-46fc-8054-5a342a5bccab service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:06:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-fc143d51-92f9-43ce-9257-1f7b6ecbd1f9 req-58416829-e8b4-46fc-8054-5a342a5bccab service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] No waiting events found dispatching network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:06:55 user nova-compute[72793]: WARNING nova.compute.manager [req-fc143d51-92f9-43ce-9257-1f7b6ecbd1f9 req-58416829-e8b4-46fc-8054-5a342a5bccab service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received unexpected event network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 for instance with vm_state active and task_state None.
Aug 17 04:06:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:06:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:04 user nova-compute[72793]: INFO nova.compute.manager [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Terminating instance
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-f336178f-e789-4f9e-bde4-53ba6ec6572f req-3c04f00e-3095-4511-b8e8-463187c633db service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-unplugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f336178f-e789-4f9e-bde4-53ba6ec6572f req-3c04f00e-3095-4511-b8e8-463187c633db service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f336178f-e789-4f9e-bde4-53ba6ec6572f req-3c04f00e-3095-4511-b8e8-463187c633db service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f336178f-e789-4f9e-bde4-53ba6ec6572f req-3c04f00e-3095-4511-b8e8-463187c633db service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-f336178f-e789-4f9e-bde4-53ba6ec6572f req-3c04f00e-3095-4511-b8e8-463187c633db service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-unplugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-f336178f-e789-4f9e-bde4-53ba6ec6572f req-3c04f00e-3095-4511-b8e8-463187c633db service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-unplugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updating instance_info_cache with network_info: [{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Instance destroyed successfully.
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'resources' on Instance uuid 245698d6-2693-404a-b365-e17fc5665259 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:00:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812116502',display_name='tempest-TestMinimumBasicScenario-server-812116502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812116502',id=13,image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN79szzICC00Dbk3h4sD5anhGgYMGJBeVvfL93fsOxN0m2IUuCaq+YaMXyw1pWaDeXYjdWRstBu/R49xPZgXW6kroj7sIPAiABNGniM4BcfeES55lSmGI/QwS9FaKK7nRw==',key_name='tempest-TestMinimumBasicScenario-574191377',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-6qfcdjeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e2a60a23-19a3-4dee-8a4c-11628e30ec03',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:22Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=245698d6-2693-404a-b365-e17fc5665259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "0e78924b-74b3-4441-917d-1bd448b0a420", "address": "fa:16:3e:1e:f6:ad", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e78924b-74", "ovs_interfaceid": "0e78924b-74b3-4441-917d-1bd448b0a420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG os_vif [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e78924b-74, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:07:04 user nova-compute[72793]: INFO os_vif [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:f6:ad,bridge_name='br-int',has_traffic_filtering=True,id=0e78924b-74b3-4441-917d-1bd448b0a420,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e78924b-74')
Aug 17 04:07:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Deleting instance files /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259_del
Aug 17 04:07:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Deletion of /opt/stack/data/nova/instances/245698d6-2693-404a-b365-e17fc5665259_del complete
Aug 17 04:07:05 user nova-compute[72793]: INFO nova.compute.manager [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 245698d6-2693-404a-b365-e17fc5665259] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 04:07:05 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:07:05 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] Took 0.79 seconds to deallocate network for instance.
Aug 17 04:07:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-95c2296d-501f-474c-8887-1204d3d63325 req-f7e7c50a-f988-4571-a7e9-fcd2dc51438a service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-deleted-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.263s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:07:06 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Deleted allocations for instance 245698d6-2693-404a-b365-e17fc5665259
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-197edb9d-e71e-4624-a22a-986c93644666 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "245698d6-2693-404a-b365-e17fc5665259" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-9d231630-a89a-412b-a515-479a95a93548 req-b3d0d341-f8df-4319-a511-1fa64d609984 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9d231630-a89a-412b-a515-479a95a93548 req-b3d0d341-f8df-4319-a511-1fa64d609984 service nova] Acquiring lock "245698d6-2693-404a-b365-e17fc5665259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9d231630-a89a-412b-a515-479a95a93548 req-b3d0d341-f8df-4319-a511-1fa64d609984 service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9d231630-a89a-412b-a515-479a95a93548 req-b3d0d341-f8df-4319-a511-1fa64d609984 service nova] Lock "245698d6-2693-404a-b365-e17fc5665259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-9d231630-a89a-412b-a515-479a95a93548 req-b3d0d341-f8df-4319-a511-1fa64d609984 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] No waiting events found dispatching network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:06 user nova-compute[72793]: WARNING nova.compute.manager [req-9d231630-a89a-412b-a515-479a95a93548 req-b3d0d341-f8df-4319-a511-1fa64d609984 service nova] [instance: 245698d6-2693-404a-b365-e17fc5665259] Received unexpected event network-vif-plugged-0e78924b-74b3-4441-917d-1bd448b0a420 for instance with vm_state deleted and task_state None.
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:07:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:07 user nova-compute[72793]: INFO nova.compute.manager [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Rescuing
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:07 user nova-compute[72793]: INFO nova.compute.manager [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Detaching volume 908b6760-985b-4839-ad93-9e0f44af5afd
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:07 user nova-compute[72793]: INFO nova.virt.block_device [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Attempting to driver detach volume 908b6760-985b-4839-ad93-9e0f44af5afd from mountpoint /dev/vdb
Aug 17 04:07:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Attempting to detach device vdb from instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:07:07 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:07:07 user nova-compute[72793]:   <source dev="/dev/sdh"/>
Aug 17 04:07:07 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:07:07 user nova-compute[72793]:   <serial>908b6760-985b-4839-ad93-9e0f44af5afd</serial>
Aug 17 04:07:07 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:07:07 user nova-compute[72793]: </disk>
Aug 17 04:07:07 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:07:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully detached device vdb from instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a from the persistent domain config.
Aug 17 04:07:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:07:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:07:07 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:07:07 user nova-compute[72793]:   <source dev="/dev/sdh"/>
Aug 17 04:07:07 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:07:07 user nova-compute[72793]:   <serial>908b6760-985b-4839-ad93-9e0f44af5afd</serial>
Aug 17 04:07:07 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:07:07 user nova-compute[72793]: </disk>
Aug 17 04:07:07 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updating instance_info_cache with network_info: [{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245228.363992, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:07:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully detached device vdb from instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a from the live domain config.
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfvHXxRq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:07:08 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff61e04-1766-40df-9198-f6af1cdcc266]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc93c97-dfb0-454e-9980-e6c78c92794c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:07:08 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:07:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd (non-flash)
Aug 17 04:07:08 user nova-compute[72793]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:07:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acf76a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd'): ({'sdh'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Removing single pathed devices sdh {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16e46e9-645e-4191-a32e-bcb27f3157e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[803528aa-0d01-4cc1-8a32-528b0c8c1da7]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flushing IO for device /dev/sdh {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd5a4c0-716b-4229-bf27-3d532a8ea2e3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da68241-2e02-4864-8542-29c75f045e72]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] SCSI volumes sdh have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a16aa75-8df8-4dc9-a945-fe2909bdfa27]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-2e3ea663-70c2-416e-ae57-a7d608585b2f req-3f809241-3087-499e-b6e2-6215b4bc5b6b service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-unplugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2e3ea663-70c2-416e-ae57-a7d608585b2f req-3f809241-3087-499e-b6e2-6215b4bc5b6b service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2e3ea663-70c2-416e-ae57-a7d608585b2f req-3f809241-3087-499e-b6e2-6215b4bc5b6b service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2e3ea663-70c2-416e-ae57-a7d608585b2f req-3f809241-3087-499e-b6e2-6215b4bc5b6b service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-2e3ea663-70c2-416e-ae57-a7d608585b2f req-3f809241-3087-499e-b6e2-6215b4bc5b6b service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-unplugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:08 user nova-compute[72793]: WARNING nova.compute.manager [req-2e3ea663-70c2-416e-ae57-a7d608585b2f req-3f809241-3087-499e-b6e2-6215b4bc5b6b service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-unplugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state active and task_state rescuing.
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c89d8-f046-480e-8a8c-e2e4e523bf86]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260]
Aug 17 04:07:08 user nova-compute[72793]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd, portal: 172.16.0.220,3260] successful.
Aug 17 04:07:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:908b6760-985b-4839-ad93-9e0f44af5afd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a508a994-76a4-47ea-a8f0-acf202a86160]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== disconnect_volume: return (335ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance destroyed successfully.
Aug 17 04:07:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Attempting rescue
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72793) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:07:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Creating image(s)
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'migration_context' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Start _get_guest_xml network_info=[{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:e3:86:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'resources' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'numa_topology' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:07:09 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1885957072',display_name='tempest-ServerRescueNegativeTestJSON-server-1885957072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1885957072',id=24,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-8p7zlh0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:25Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=4491ef6b-8f7c-4360-bb15-448dd2959a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:e3:86:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:e3:86:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'pci_devices' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'flavor' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:07:09 user nova-compute[72793]:   <uuid>4491ef6b-8f7c-4360-bb15-448dd2959a99</uuid>
Aug 17 04:07:09 user nova-compute[72793]:   <name>instance-00000018</name>
Aug 17 04:07:09 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:07:09 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:07:09 user nova-compute[72793]:   <metadata>
Aug 17 04:07:09 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:07:09 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:07:09 user nova-compute[72793]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1885957072</nova:name>
Aug 17 04:07:09 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:07:09</nova:creationTime>
Aug 17 04:07:09 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:07:09 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:07:09 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:07:09 user nova-compute[72793]:       <nova:owner>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:user uuid="cbad450f600b4d0aac294be4cd145fa5">tempest-ServerRescueNegativeTestJSON-1617582959-project-member</nova:user>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:project uuid="fba66a3ba645414983fd9fa888e734c9">tempest-ServerRescueNegativeTestJSON-1617582959</nova:project>
Aug 17 04:07:09 user nova-compute[72793]:       </nova:owner>
Aug 17 04:07:09 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:07:09 user nova-compute[72793]:       <nova:ports>
Aug 17 04:07:09 user nova-compute[72793]:         <nova:port uuid="4c4b5504-d88a-4921-8899-4c689002bd0d">
Aug 17 04:07:09 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 04:07:09 user nova-compute[72793]:         </nova:port>
Aug 17 04:07:09 user nova-compute[72793]:       </nova:ports>
Aug 17 04:07:09 user nova-compute[72793]:     </nova:instance>
Aug 17 04:07:09 user nova-compute[72793]:   </metadata>
Aug 17 04:07:09 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:07:09 user nova-compute[72793]:     <system>
Aug 17 04:07:09 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:07:09 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:07:09 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:07:09 user nova-compute[72793]:       <entry name="serial">4491ef6b-8f7c-4360-bb15-448dd2959a99</entry>
Aug 17 04:07:09 user nova-compute[72793]:       <entry name="uuid">4491ef6b-8f7c-4360-bb15-448dd2959a99</entry>
Aug 17 04:07:09 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:07:09 user nova-compute[72793]:     </system>
Aug 17 04:07:09 user nova-compute[72793]:   </sysinfo>
Aug 17 04:07:09 user nova-compute[72793]:   <os>
Aug 17 04:07:09 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:07:09 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:07:09 user nova-compute[72793]:   </os>
Aug 17 04:07:09 user nova-compute[72793]:   <features>
Aug 17 04:07:09 user nova-compute[72793]:     <acpi/>
Aug 17 04:07:09 user nova-compute[72793]:     <apic/>
Aug 17 04:07:09 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:07:09 user nova-compute[72793]:   </features>
Aug 17 04:07:09 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:07:09 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:07:09 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:07:09 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:07:09 user nova-compute[72793]:   </clock>
Aug 17 04:07:09 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:07:09 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:07:09 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:07:09 user nova-compute[72793]:   </cpu>
Aug 17 04:07:09 user nova-compute[72793]:   <devices>
Aug 17 04:07:09 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:07:09 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:07:09 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue"/>
Aug 17 04:07:09 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:07:09 user nova-compute[72793]:     </disk>
Aug 17 04:07:09 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:07:09 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:07:09 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk"/>
Aug 17 04:07:09 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:07:09 user nova-compute[72793]:     </disk>
Aug 17 04:07:09 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:07:09 user nova-compute[72793]:       <mac address="fa:16:3e:e3:86:44"/>
Aug 17 04:07:09 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:07:09 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:07:09 user nova-compute[72793]:       <target dev="tap4c4b5504-d8"/>
Aug 17 04:07:09 user nova-compute[72793]:     </interface>
Aug 17 04:07:09 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:07:09 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/console.log" append="off"/>
Aug 17 04:07:09 user nova-compute[72793]:     </serial>
Aug 17 04:07:09 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:07:09 user nova-compute[72793]:     <video>
Aug 17 04:07:09 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:07:09 user nova-compute[72793]:     </video>
Aug 17 04:07:09 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:07:09 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:07:09 user nova-compute[72793]:     </rng>
Aug 17 04:07:09 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:07:09 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:07:09 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:07:09 user nova-compute[72793]:     </memballoon>
Aug 17 04:07:09 user nova-compute[72793]:   </devices>
Aug 17 04:07:09 user nova-compute[72793]: </domain>
Aug 17 04:07:09 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:07:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance destroyed successfully.
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0674d5f7-468f-4557-a47c-e231fdf7059f tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.980s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:e3:86:44, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-3649bbc0-3ce8-4d3e-84da-bb21d631443d req-306027b8-650f-405e-aa14-b020f0b2bff4 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3649bbc0-3ce8-4d3e-84da-bb21d631443d req-306027b8-650f-405e-aa14-b020f0b2bff4 service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3649bbc0-3ce8-4d3e-84da-bb21d631443d req-306027b8-650f-405e-aa14-b020f0b2bff4 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3649bbc0-3ce8-4d3e-84da-bb21d631443d req-306027b8-650f-405e-aa14-b020f0b2bff4 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-3649bbc0-3ce8-4d3e-84da-bb21d631443d req-306027b8-650f-405e-aa14-b020f0b2bff4 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:10 user nova-compute[72793]: WARNING nova.compute.manager [req-3649bbc0-3ce8-4d3e-84da-bb21d631443d req-306027b8-650f-405e-aa14-b020f0b2bff4 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state active and task_state rescuing.
Aug 17 04:07:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:13 user nova-compute[72793]: WARNING nova.compute.manager [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state active and task_state rescuing.
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:13 user nova-compute[72793]: WARNING nova.compute.manager [req-545f0904-0aa2-4320-b0c7-0de2fda9d794 req-3b743816-679c-40ca-a5be-c40d5143df76 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state active and task_state rescuing.
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for 4491ef6b-8f7c-4360-bb15-448dd2959a99 due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245233.473611, 4491ef6b-8f7c-4360-bb15-448dd2959a99 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:07:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] VM Resumed (Lifecycle Event)
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e01e84a4-02aa-4332-a287-a5fb3c2f414a tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:07:13 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:07:13 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7230MB free_disk=25.403793334960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:07:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245233.4740446, 4491ef6b-8f7c-4360-bb15-448dd2959a99 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:07:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] VM Started (Lifecycle Event)
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4eaa5595-c08e-48a3-a731-66b740d355ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:07:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:07:14 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:07:14 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:07:14 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:07:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:07:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:19 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245224.864677, 245698d6-2693-404a-b365-e17fc5665259 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:07:19 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 245698d6-2693-404a-b365-e17fc5665259] VM Stopped (Lifecycle Event)
Aug 17 04:07:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6c95da31-faf4-4e71-a954-826b35f07a06 None None] [instance: 245698d6-2693-404a-b365-e17fc5665259] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:07:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:33 user nova-compute[72793]: INFO nova.compute.manager [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Unshelving
Aug 17 04:07:33 user nova-compute[72793]: INFO nova.virt.block_device [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Booting with volume 91b284eb-7f3c-4321-b2dd-b68999e283e7 at /dev/vdc
Aug 17 04:07:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b097dc7-0720-4a0d-87f8-954bfb45bfeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb672ae-d377-45fd-82b7-b0484c74e8bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb9dfb-f148-4c78-bdfc-d1f6cdf2597f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fddc8b-5a63-4d21-95ad-a41f5b8b3c4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:07:34 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:07:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc59ac-1e48-4d4a-a7bd-a196ecc15440]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG os_brick.utils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating existing volume attachment record: 6de23f15-90ef-43bb-b6cb-7333fe846885 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:07:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-changed-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Refreshing instance network info cache due to event network-changed-cc891a9e-5324-4a9f-9d12-930773b32e25. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:07:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] Acquiring lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:07:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] Acquired lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:07:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Refreshing network info cache for port cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:07:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'flavor' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'pci_requests' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'numa_topology' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updated VIF entry in instance network info cache for port cc891a9e-5324-4a9f-9d12-930773b32e25. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updating instance_info_cache with network_info: [{"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:07:45 user nova-compute[72793]: INFO nova.compute.claims [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Claim successful on node user
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ff6199d6-6ad6-426e-99b3-b14b089b73e3 req-f1d20684-695e-4125-91b0-b84c182f8571 service nova] Releasing lock "refresh_cache-17cc3235-4e5d-41de-91ba-8cca63ba2585" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:45 user nova-compute[72793]: INFO nova.compute.manager [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attaching volume a25dc2d1-5089-437b-97c5-10a0b75d98f4 to /dev/vdb
Aug 17 04:07:45 user nova-compute[72793]: DEBUG os_brick.utils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aac13c-99cd-42a5-b667-f0f023d61ba4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3010c8-217f-4f1e-bba6-c5936872c496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef02eb-ae70-4edd-a674-fd279e57199b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d806122f-e5ee-4209-83c3-947c7ffdfc61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:07:45 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5034da9-8f7c-4b98-9ffc-69964741e9b5]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG os_brick.utils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updating existing volume attachment record: 5b7f8ad9-140c-4dde-abb6-f1b84b23cb0d {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:07:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:46 user nova-compute[72793]: INFO nova.network.neutron [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing instance network info cache due to event network-changed-1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:07:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] Acquiring lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:07:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Creating image(s)
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] Acquired lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG nova.network.neutron [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Refreshing network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0d0afb77ce0cb406eab6b7e481792c905669c483" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0d0afb77ce0cb406eab6b7e481792c905669c483" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.part --force-share --output=json" returned: 0 in 0.223s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG nova.virt.images [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] f5a104bd-51e3-4326-bb69-353b46e69c39 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:07:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.part /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updated VIF entry in instance network info cache for port 1d7ebec7-8e91-448f-83b0-340f8d4f68a7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3b89e7e1-af57-4415-bd67-f9b6e0a08f83 req-c28dc419-35c2-4be2-a96e-f6ec89bef01e service nova] Releasing lock "refresh_cache-0caea72b-8769-4feb-ac34-5904ba45308f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.part /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.converted" returned: 0 in 0.665s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0d0afb77ce0cb406eab6b7e481792c905669c483" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.203s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0d0afb77ce0cb406eab6b7e481792c905669c483" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0d0afb77ce0cb406eab6b7e481792c905669c483" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483,backing_fmt=raw /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483,backing_fmt=raw /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk 1073741824" returned: 0 in 0.047s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0d0afb77ce0cb406eab6b7e481792c905669c483" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'flavor' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 --force-share --output=json" returned: 0 in 0.241s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'migration_context' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:52 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Rebasing disk image.
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.224s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d -F raw /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:52 user nova-compute[72793]: INFO nova.compute.manager [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Attaching volume 28f92a50-761e-4606-88d8-e13897b1aebf to /dev/vdb
Aug 17 04:07:52 user nova-compute[72793]: DEBUG os_brick.utils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24270c0-96e2-4aad-bc46-9c486659e508]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[029a0639-0877-49c2-a8ed-24b8f5bb77b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff0446f-bc5e-49a1-9f92-339ec897a85e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[da640d0e-bc28-4847-85b0-16ab9c37e85f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:07:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:07:53 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:07:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2443fee2-40f0-402f-817b-76eb30a8ead8]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:07:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:07:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:07:53 user nova-compute[72793]: DEBUG os_brick.utils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:07:53 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating existing volume attachment record: 16743062-0c8a-47f6-ba19-fe506c08f665 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d -F raw /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk" returned: 0 in 2.944s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Ensure instance console log exists: /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Start _get_guest_xml network_info=[{"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e2277c0623d272855866e226ede9ad8f',container_format='bare',created_at=2023-08-17T04:05:41Z,direct_url=<?>,disk_format='qcow2',id=f5a104bd-51e3-4326-bb69-353b46e69c39,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1507473122-shelved',owner='f916dfd267de46389faa83f4947db86f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T04:05:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQiqfCpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0caea72b-8769-4feb-ac34-5904ba45308f', 'attached_at': '', 'detached_at': '', 'volume_id': '91b284eb-7f3c-4321-b2dd-b68999e283e7', 'serial': '91b284eb-7f3c-4321-b2dd-b68999e283e7'}, 'guest_format': None, 'attachment_id': '6de23f15-90ef-43bb-b6cb-7333fe846885', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:07:55 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:07:55 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e2277c0623d272855866e226ede9ad8f',container_format='bare',created_at=2023-08-17T04:05:41Z,direct_url=<?>,disk_format='qcow2',id=f5a104bd-51e3-4326-bb69-353b46e69c39,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1507473122-shelved',owner='f916dfd267de46389faa83f4947db86f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T04:05:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQiqfCpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:07:55 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:07:55 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:07:55 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc618ebe-bdf7-4df7-8977-d50d2d9aa918]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:07:55 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8ab6f5-dd84-4901-a10f-f492a1c3375e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7] added
Aug 17 04:07:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[27696e29-0144-4c2d-a57c-f2651b807c85]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a6197-7443-4097-b75b-7db37fe4edc8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQiqfCpd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQiqfCpd" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a5508-4109-4b06-afe6-10b46e76c33a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQiqfCpd'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f14d451-5053-4a76-845e-a8faa00f6977]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9cbff3-b5bb-4745-b0c5-0439de2b464c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:07:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:07:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:07:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b880fe-ed3c-4fa0-9485-2e9d7476af8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260]
Aug 17 04:07:56 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260] successful.
Aug 17 04:07:56 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acad9b3-a786-467f-92de-cc6d88b618b0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b227c9e4-3bfe-4ebc-9b4a-16f91a5d840f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:07:56 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:07:56 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:07:56 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:07:56 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb524f3-3b12-4439-b072-538052750420]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:07:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQiqfCpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23731653236613831', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731653236613831', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1507473122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1507473122',id=19,image_ref='f5a104bd-51e3-4326-bb69-353b46e69c39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-208159808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-ndrldmu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member',shelved_at='2023-08-17T04:05:44.946301',shelved_host='user',shelved_image_id='f5a104bd-51e3-4326-bb69-353b46e69c39'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=0caea72b-8769-4feb-ac34-5904ba45308f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'pci_devices' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:07:57 user nova-compute[72793]:   <uuid>0caea72b-8769-4feb-ac34-5904ba45308f</uuid>
Aug 17 04:07:57 user nova-compute[72793]:   <name>instance-00000013</name>
Aug 17 04:07:57 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:07:57 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:07:57 user nova-compute[72793]:   <metadata>
Aug 17 04:07:57 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:07:57 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:07:57 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1507473122</nova:name>
Aug 17 04:07:57 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:07:55</nova:creationTime>
Aug 17 04:07:57 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:07:57 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:07:57 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:07:57 user nova-compute[72793]:       <nova:owner>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:user uuid="e1420f8967734176ac04ac8b1e2646ea">tempest-AttachVolumeShelveTestJSON-266550928-project-member</nova:user>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:project uuid="f916dfd267de46389faa83f4947db86f">tempest-AttachVolumeShelveTestJSON-266550928</nova:project>
Aug 17 04:07:57 user nova-compute[72793]:       </nova:owner>
Aug 17 04:07:57 user nova-compute[72793]:       <nova:root type="image" uuid="f5a104bd-51e3-4326-bb69-353b46e69c39"/>
Aug 17 04:07:57 user nova-compute[72793]:       <nova:ports>
Aug 17 04:07:57 user nova-compute[72793]:         <nova:port uuid="1d7ebec7-8e91-448f-83b0-340f8d4f68a7">
Aug 17 04:07:57 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:07:57 user nova-compute[72793]:         </nova:port>
Aug 17 04:07:57 user nova-compute[72793]:       </nova:ports>
Aug 17 04:07:57 user nova-compute[72793]:     </nova:instance>
Aug 17 04:07:57 user nova-compute[72793]:   </metadata>
Aug 17 04:07:57 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:07:57 user nova-compute[72793]:     <system>
Aug 17 04:07:57 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:07:57 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:07:57 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:07:57 user nova-compute[72793]:       <entry name="serial">0caea72b-8769-4feb-ac34-5904ba45308f</entry>
Aug 17 04:07:57 user nova-compute[72793]:       <entry name="uuid">0caea72b-8769-4feb-ac34-5904ba45308f</entry>
Aug 17 04:07:57 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:07:57 user nova-compute[72793]:     </system>
Aug 17 04:07:57 user nova-compute[72793]:   </sysinfo>
Aug 17 04:07:57 user nova-compute[72793]:   <os>
Aug 17 04:07:57 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:07:57 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:07:57 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:07:57 user nova-compute[72793]:   </os>
Aug 17 04:07:57 user nova-compute[72793]:   <features>
Aug 17 04:07:57 user nova-compute[72793]:     <acpi/>
Aug 17 04:07:57 user nova-compute[72793]:     <apic/>
Aug 17 04:07:57 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:07:57 user nova-compute[72793]:   </features>
Aug 17 04:07:57 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:07:57 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:07:57 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:07:57 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:07:57 user nova-compute[72793]:   </clock>
Aug 17 04:07:57 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:07:57 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:07:57 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:07:57 user nova-compute[72793]:   </cpu>
Aug 17 04:07:57 user nova-compute[72793]:   <devices>
Aug 17 04:07:57 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:07:57 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:07:57 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk"/>
Aug 17 04:07:57 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:07:57 user nova-compute[72793]:     </disk>
Aug 17 04:07:57 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:07:57 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:07:57 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:07:57 user nova-compute[72793]:       <target dev="vdc" bus="virtio"/>
Aug 17 04:07:57 user nova-compute[72793]:       <serial>91b284eb-7f3c-4321-b2dd-b68999e283e7</serial>
Aug 17 04:07:57 user nova-compute[72793]:     </disk>
Aug 17 04:07:57 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:07:57 user nova-compute[72793]:       <mac address="fa:16:3e:f1:87:19"/>
Aug 17 04:07:57 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:07:57 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:07:57 user nova-compute[72793]:       <target dev="tap1d7ebec7-8e"/>
Aug 17 04:07:57 user nova-compute[72793]:     </interface>
Aug 17 04:07:57 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:07:57 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/console.log" append="off"/>
Aug 17 04:07:57 user nova-compute[72793]:     </serial>
Aug 17 04:07:57 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:07:57 user nova-compute[72793]:     <video>
Aug 17 04:07:57 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:07:57 user nova-compute[72793]:     </video>
Aug 17 04:07:57 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:07:57 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:07:57 user nova-compute[72793]:     </rng>
Aug 17 04:07:57 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:07:57 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:07:57 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:07:57 user nova-compute[72793]:     </memballoon>
Aug 17 04:07:57 user nova-compute[72793]:   </devices>
Aug 17 04:07:57 user nova-compute[72793]: </domain>
Aug 17 04:07:57 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1507473122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1507473122',id=19,image_ref='f5a104bd-51e3-4326-bb69-353b46e69c39',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-208159808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-ndrldmu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member',shelved_at='2023-08-17T04:05:44.946301',shelved_host='user',shelved_image_id='f5a104bd-51e3-4326-bb69-353b46e69c39'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=0caea72b-8769-4feb-ac34-5904ba45308f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG os_vif [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d7ebec7-8e, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d7ebec7-8e, col_values=(('external_ids', {'iface-id': '1d7ebec7-8e91-448f-83b0-340f8d4f68a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:87:19', 'vm-uuid': '0caea72b-8769-4feb-ac34-5904ba45308f'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:57 user nova-compute[72793]: INFO os_vif [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e')
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:07:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No VIF found with MAC fa:16:3e:f1:87:19, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:58 user nova-compute[72793]: INFO nova.compute.manager [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Terminating instance
Aug 17 04:07:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-0b3c916e-a92d-4bad-b1f3-1c539b896d2d req-1cd8c288-6dfc-4bca-a16a-5528ddfc3403 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-unplugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0b3c916e-a92d-4bad-b1f3-1c539b896d2d req-1cd8c288-6dfc-4bca-a16a-5528ddfc3403 service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0b3c916e-a92d-4bad-b1f3-1c539b896d2d req-1cd8c288-6dfc-4bca-a16a-5528ddfc3403 service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0b3c916e-a92d-4bad-b1f3-1c539b896d2d req-1cd8c288-6dfc-4bca-a16a-5528ddfc3403 service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-0b3c916e-a92d-4bad-b1f3-1c539b896d2d req-1cd8c288-6dfc-4bca-a16a-5528ddfc3403 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-unplugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-0b3c916e-a92d-4bad-b1f3-1c539b896d2d req-1cd8c288-6dfc-4bca-a16a-5528ddfc3403 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-unplugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Instance destroyed successfully.
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.objects.instance [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'resources' on Instance uuid ecbd6261-7b55-4225-97c8-bbd02b37aa5a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-780488707',display_name='tempest-ServerActionsTestOtherA-server-321540172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-780488707',id=15,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVutA9Tlf0owhQuLQZK0QoDbulIgKPSwUdDttRITsXkGjWxHg/0URF8DFUdn+qiNuqMEbrZXqZbm7X9YC2/nPRdYJorxhdjSfVjua8acZNIGbvmKrQsrL6l9UwIXtnvUQ==',key_name='tempest-keypair-169977143',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-d0ga5een',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=ecbd6261-7b55-4225-97c8-bbd02b37aa5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "address": "fa:16:3e:a9:49:e1", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8d064e-ed", "ovs_interfaceid": "4d8d064e-ed85-494d-a8aa-c53b4f37ecfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG os_vif [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d8d064e-ed, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: INFO os_vif [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:49:e1,bridge_name='br-int',has_traffic_filtering=True,id=4d8d064e-ed85-494d-a8aa-c53b4f37ecfa,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8d064e-ed')
Aug 17 04:07:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Deleting instance files /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a_del
Aug 17 04:07:59 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Deletion of /opt/stack/data/nova/instances/ecbd6261-7b55-4225-97c8-bbd02b37aa5a_del complete
Aug 17 04:07:59 user nova-compute[72793]: INFO nova.compute.manager [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-1667ba66-32af-4c51-990d-8f7655e15887 req-c4425e70-3fd6-44ac-8652-e1c1fe806c71 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1667ba66-32af-4c51-990d-8f7655e15887 req-c4425e70-3fd6-44ac-8652-e1c1fe806c71 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1667ba66-32af-4c51-990d-8f7655e15887 req-c4425e70-3fd6-44ac-8652-e1c1fe806c71 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1667ba66-32af-4c51-990d-8f7655e15887 req-c4425e70-3fd6-44ac-8652-e1c1fe806c71 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-1667ba66-32af-4c51-990d-8f7655e15887 req-c4425e70-3fd6-44ac-8652-e1c1fe806c71 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:07:59 user nova-compute[72793]: WARNING nova.compute.manager [req-1667ba66-32af-4c51-990d-8f7655e15887 req-c4425e70-3fd6-44ac-8652-e1c1fe806c71 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:07:59 user nova-compute[72793]: INFO nova.compute.claims [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Claim successful on node user
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:07:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:08:00 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.policy [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd805a44490b4a969fd9121571f17bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909f9614d1c64730bdcaf1b4d86516da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:08:00 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Creating image(s)
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "/opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "/opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "/opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "9131746a2708112874bba893dec81b6b545dd803" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "9131746a2708112874bba893dec81b6b545dd803" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-df610e9e-fb89-4fcd-993c-a2d0e5bba205 req-282ee4d6-08f8-49bb-8a0d-cc7375fa346e service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-df610e9e-fb89-4fcd-993c-a2d0e5bba205 req-282ee4d6-08f8-49bb-8a0d-cc7375fa346e service nova] Acquiring lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-df610e9e-fb89-4fcd-993c-a2d0e5bba205 req-282ee4d6-08f8-49bb-8a0d-cc7375fa346e service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-df610e9e-fb89-4fcd-993c-a2d0e5bba205 req-282ee4d6-08f8-49bb-8a0d-cc7375fa346e service nova] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-df610e9e-fb89-4fcd-993c-a2d0e5bba205 req-282ee4d6-08f8-49bb-8a0d-cc7375fa346e service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] No waiting events found dispatching network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:00 user nova-compute[72793]: WARNING nova.compute.manager [req-df610e9e-fb89-4fcd-993c-a2d0e5bba205 req-282ee4d6-08f8-49bb-8a0d-cc7375fa346e service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received unexpected event network-vif-plugged-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa for instance with vm_state active and task_state deleting.
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:01 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Took 1.97 seconds to deallocate network for instance.
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.part --force-share --output=json" returned: 0 in 0.277s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG nova.virt.images [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] 940acbe3-b597-4a6b-81c9-964f843559c8 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.part /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Successfully created port: 2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-f2a63959-da57-4e57-91c7-bbffc7492ccf req-756e806a-2a32-4c5b-90d9-07175e421600 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f2a63959-da57-4e57-91c7-bbffc7492ccf req-756e806a-2a32-4c5b-90d9-07175e421600 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f2a63959-da57-4e57-91c7-bbffc7492ccf req-756e806a-2a32-4c5b-90d9-07175e421600 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f2a63959-da57-4e57-91c7-bbffc7492ccf req-756e806a-2a32-4c5b-90d9-07175e421600 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-f2a63959-da57-4e57-91c7-bbffc7492ccf req-756e806a-2a32-4c5b-90d9-07175e421600 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:01 user nova-compute[72793]: WARNING nova.compute.manager [req-f2a63959-da57-4e57-91c7-bbffc7492ccf req-756e806a-2a32-4c5b-90d9-07175e421600 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.part /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.converted" returned: 0 in 0.489s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245282.0904872, 0caea72b-8769-4feb-ac34-5904ba45308f => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] VM Resumed (Lifecycle Event)
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance spawned successfully.
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.760s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245282.0931363, 0caea72b-8769-4feb-ac34-5904ba45308f => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] VM Started (Lifecycle Event)
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "9131746a2708112874bba893dec81b6b545dd803" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.579s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:02 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Deleted allocations for instance ecbd6261-7b55-4225-97c8-bbd02b37aa5a
Aug 17 04:08:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 --force-share --output=json" returned: 0 in 0.239s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "9131746a2708112874bba893dec81b6b545dd803" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "9131746a2708112874bba893dec81b6b545dd803" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-32cd2e4c-7b24-4546-b2a7-47526b27f854 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "ecbd6261-7b55-4225-97c8-bbd02b37aa5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.377s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Successfully updated port: 2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "refresh_cache-28af729a-94d4-4e5f-ba09-98aa0b85ffed" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquired lock "refresh_cache-28af729a-94d4-4e5f-ba09-98aa0b85ffed" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803,backing_fmt=raw /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a0abfa43-f354-4b0e-b5da-c5502e9759e8 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.843s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-be0524a4-c0ae-496b-9e27-327c564894ab req-7fb97764-098c-4f41-a6c6-13abc9080805 service nova] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Received event network-vif-deleted-4d8d064e-ed85-494d-a8aa-c53b4f37ecfa {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803,backing_fmt=raw /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk 1073741824" returned: 0 in 0.067s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "9131746a2708112874bba893dec81b6b545dd803" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:08:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Cannot resize image /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'migration_context' on Instance uuid 28af729a-94d4-4e5f-ba09-98aa0b85ffed {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Ensure instance console log exists: /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Updating instance_info_cache with network_info: [{"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Releasing lock "refresh_cache-28af729a-94d4-4e5f-ba09-98aa0b85ffed" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Instance network_info: |[{"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Start _get_guest_xml network_info=[{"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T04:07:56Z,direct_url=<?>,disk_format='qcow2',id=940acbe3-b597-4a6b-81c9-964f843559c8,min_disk=0,min_ram=0,name='tempest-scenario-img--2098795410',owner='909f9614d1c64730bdcaf1b4d86516da',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T04:07:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '940acbe3-b597-4a6b-81c9-964f843559c8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:08:03 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:03 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T04:07:56Z,direct_url=<?>,disk_format='qcow2',id=940acbe3-b597-4a6b-81c9-964f843559c8,min_disk=0,min_ram=0,name='tempest-scenario-img--2098795410',owner='909f9614d1c64730bdcaf1b4d86516da',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T04:07:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1038027461',display_name='tempest-TestMinimumBasicScenario-server-1038027461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1038027461',id=27,image_ref='940acbe3-b597-4a6b-81c9-964f843559c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDI9D926LLIZb+XIFkPSNB4DnPX26fgoFY3n30Xf+jYw2zksmahTwF62rlQaH/nhHYtq4Xe95SOngYTXix040rzkmpdl6JzuXcs73+3l8WUsYcYAMmVbMQpXBQ36gRFRQ==',key_name='tempest-TestMinimumBasicScenario-1840355347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-zkuff2o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='940acbe3-b597-4a6b-81c9-964f843559c8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:08:01Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=28af729a-94d4-4e5f-ba09-98aa0b85ffed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'pci_devices' on Instance uuid 28af729a-94d4-4e5f-ba09-98aa0b85ffed {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:08:03 user nova-compute[72793]:   <uuid>28af729a-94d4-4e5f-ba09-98aa0b85ffed</uuid>
Aug 17 04:08:03 user nova-compute[72793]:   <name>instance-0000001b</name>
Aug 17 04:08:03 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:08:03 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:08:03 user nova-compute[72793]:   <metadata>
Aug 17 04:08:03 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:08:03 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:08:03 user nova-compute[72793]:       <nova:name>tempest-TestMinimumBasicScenario-server-1038027461</nova:name>
Aug 17 04:08:03 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:08:03</nova:creationTime>
Aug 17 04:08:03 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:08:03 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:08:03 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:08:03 user nova-compute[72793]:       <nova:owner>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:user uuid="cd805a44490b4a969fd9121571f17bb1">tempest-TestMinimumBasicScenario-660102196-project-member</nova:user>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:project uuid="909f9614d1c64730bdcaf1b4d86516da">tempest-TestMinimumBasicScenario-660102196</nova:project>
Aug 17 04:08:03 user nova-compute[72793]:       </nova:owner>
Aug 17 04:08:03 user nova-compute[72793]:       <nova:root type="image" uuid="940acbe3-b597-4a6b-81c9-964f843559c8"/>
Aug 17 04:08:03 user nova-compute[72793]:       <nova:ports>
Aug 17 04:08:03 user nova-compute[72793]:         <nova:port uuid="2937b911-86f5-4338-a43e-97af2780da92">
Aug 17 04:08:03 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:08:03 user nova-compute[72793]:         </nova:port>
Aug 17 04:08:03 user nova-compute[72793]:       </nova:ports>
Aug 17 04:08:03 user nova-compute[72793]:     </nova:instance>
Aug 17 04:08:03 user nova-compute[72793]:   </metadata>
Aug 17 04:08:03 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:08:03 user nova-compute[72793]:     <system>
Aug 17 04:08:03 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:08:03 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:08:03 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:08:03 user nova-compute[72793]:       <entry name="serial">28af729a-94d4-4e5f-ba09-98aa0b85ffed</entry>
Aug 17 04:08:03 user nova-compute[72793]:       <entry name="uuid">28af729a-94d4-4e5f-ba09-98aa0b85ffed</entry>
Aug 17 04:08:03 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:08:03 user nova-compute[72793]:     </system>
Aug 17 04:08:03 user nova-compute[72793]:   </sysinfo>
Aug 17 04:08:03 user nova-compute[72793]:   <os>
Aug 17 04:08:03 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:08:03 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:08:03 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:08:03 user nova-compute[72793]:   </os>
Aug 17 04:08:03 user nova-compute[72793]:   <features>
Aug 17 04:08:03 user nova-compute[72793]:     <acpi/>
Aug 17 04:08:03 user nova-compute[72793]:     <apic/>
Aug 17 04:08:03 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:08:03 user nova-compute[72793]:   </features>
Aug 17 04:08:03 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:08:03 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:08:03 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:08:03 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:08:03 user nova-compute[72793]:   </clock>
Aug 17 04:08:03 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:08:03 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:08:03 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:08:03 user nova-compute[72793]:   </cpu>
Aug 17 04:08:03 user nova-compute[72793]:   <devices>
Aug 17 04:08:03 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:08:03 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:08:03 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk"/>
Aug 17 04:08:03 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:08:03 user nova-compute[72793]:     </disk>
Aug 17 04:08:03 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:08:03 user nova-compute[72793]:       <mac address="fa:16:3e:4b:0c:fe"/>
Aug 17 04:08:03 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:08:03 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:08:03 user nova-compute[72793]:       <target dev="tap2937b911-86"/>
Aug 17 04:08:03 user nova-compute[72793]:     </interface>
Aug 17 04:08:03 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:08:03 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/console.log" append="off"/>
Aug 17 04:08:03 user nova-compute[72793]:     </serial>
Aug 17 04:08:03 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:08:03 user nova-compute[72793]:     <video>
Aug 17 04:08:03 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:08:03 user nova-compute[72793]:     </video>
Aug 17 04:08:03 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:08:03 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:08:03 user nova-compute[72793]:     </rng>
Aug 17 04:08:03 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:08:03 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:08:03 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:08:03 user nova-compute[72793]:     </memballoon>
Aug 17 04:08:03 user nova-compute[72793]:   </devices>
Aug 17 04:08:03 user nova-compute[72793]: </domain>
Aug 17 04:08:03 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1038027461',display_name='tempest-TestMinimumBasicScenario-server-1038027461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1038027461',id=27,image_ref='940acbe3-b597-4a6b-81c9-964f843559c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDI9D926LLIZb+XIFkPSNB4DnPX26fgoFY3n30Xf+jYw2zksmahTwF62rlQaH/nhHYtq4Xe95SOngYTXix040rzkmpdl6JzuXcs73+3l8WUsYcYAMmVbMQpXBQ36gRFRQ==',key_name='tempest-TestMinimumBasicScenario-1840355347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-zkuff2o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='940acbe3-b597-4a6b-81c9-964f843559c8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:08:01Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=28af729a-94d4-4e5f-ba09-98aa0b85ffed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG os_vif [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2937b911-86, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2937b911-86, col_values=(('external_ids', {'iface-id': '2937b911-86f5-4338-a43e-97af2780da92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0c:fe', 'vm-uuid': '28af729a-94d4-4e5f-ba09-98aa0b85ffed'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:08:03 user nova-compute[72793]: INFO os_vif [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86')
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] No VIF found with MAC fa:16:3e:4b:0c:fe, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-changed-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Refreshing instance network info cache due to event network-changed-2937b911-86f5-4338-a43e-97af2780da92. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] Acquiring lock "refresh_cache-28af729a-94d4-4e5f-ba09-98aa0b85ffed" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] Acquired lock "refresh_cache-28af729a-94d4-4e5f-ba09-98aa0b85ffed" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Refreshing network info cache for port 2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Updated VIF entry in instance network info cache for port 2937b911-86f5-4338-a43e-97af2780da92. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Updating instance_info_cache with network_info: [{"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63e422a6-52b5-4b65-8ad1-754d204f19ba req-a612534f-6ecf-469a-9a8f-bc6918d14f45 service nova] Releasing lock "refresh_cache-28af729a-94d4-4e5f-ba09-98aa0b85ffed" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMrlaFRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:04 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:04 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:04 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c71276-f39a-49ed-a5ae-2763d3cef953]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:08:04 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b75369-b7d4-44f9-95b6-3fee15d75ac0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4] added
Aug 17 04:08:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9259f-9aa8-49fc-a863-f56307f7f4ad]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9d5c7-e43f-4e35-9ab1-5ba8fa131fe3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMrlaFRw {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMrlaFRw" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb15102-7521-4fb9-9ae0-b8cfbabf3b05]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMrlaFRw'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[961b748a-b5cf-435c-9bc4-8774f8e09b40]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f0032d-b08c-49da-9028-5f4c55319ca3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:04 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:04 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[73252467-d445-47a2-a5c5-4e8ae042f4e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260]
Aug 17 04:08:04 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260] successful.
Aug 17 04:08:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d788b34-245f-4ca6-9378-d97980fbcada]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[73742281-28e9-4d00-9edc-d38dd9f7045b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:04 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:04 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:04 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:04 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0686e843-9200-4257-812f-3ce6cd2cd7f6]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMrlaFRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:08:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-c3d14b02-67c6-42ce-a65c-d7d0906661c5 req-18222783-214e-4b52-a541-aa5c4b754758 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c3d14b02-67c6-42ce-a65c-d7d0906661c5 req-18222783-214e-4b52-a541-aa5c4b754758 service nova] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c3d14b02-67c6-42ce-a65c-d7d0906661c5 req-18222783-214e-4b52-a541-aa5c4b754758 service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c3d14b02-67c6-42ce-a65c-d7d0906661c5 req-18222783-214e-4b52-a541-aa5c4b754758 service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-c3d14b02-67c6-42ce-a65c-d7d0906661c5 req-18222783-214e-4b52-a541-aa5c4b754758 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] No waiting events found dispatching network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:05 user nova-compute[72793]: WARNING nova.compute.manager [req-c3d14b02-67c6-42ce-a65c-d7d0906661c5 req-18222783-214e-4b52-a541-aa5c4b754758 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received unexpected event network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 for instance with vm_state building and task_state spawning.
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRPqYsIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26462313433323066', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462313433323066', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.186s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:05 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'flavor' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[74481bcc-3bee-4578-be0b-3318f476d4fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:08:05 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:08:05 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:05 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:08:05 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:08:05 user nova-compute[72793]:   <serial>a25dc2d1-5089-437b-97c5-10a0b75d98f4</serial>
Aug 17 04:08:05 user nova-compute[72793]: </disk>
Aug 17 04:08:05 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[110dcc11-292d-4fda-8fc6-2c689f6febe8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf] added
Aug 17 04:08:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf4bee-e37a-4cf7-9296-ffbf540f284d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ab48b1-1910-4b38-862b-da355cf4af0c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRPqYsIk {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRPqYsIk" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d664ba9-c7b5-446e-b69d-e4d41f66dbd5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRPqYsIk'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9e77b-d269-454c-8ae8-fa66e14588b4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78a42c2-5ed8-4be6-ad67-2fa72d2a93a0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:05 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:05 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:05 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:05 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e651a7e6-b98b-4412-b764-745fe338dabd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260]
Aug 17 04:08:05 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260] successful.
Aug 17 04:08:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ccad97-823a-418d-8d12-cff3b154b541]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67481f9a-eea5-417e-a2ce-019e4bc1a3e8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:06 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:06 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:06 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:06 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:06 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:06 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[51633464-7b18-4409-ba4a-8dcb7f6a499f]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRPqYsIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No VIF found with MAC fa:16:3e:00:57:30, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fef38d2a-8bd8-4eb7-8bef-65738381fa13 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.945s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] <== connect_volume: return (1568ms) {'type': 'block', 'scsi_wwn': '23064646261363936', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064646261363936', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'flavor' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:08:07 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:07 user nova-compute[72793]:   <source dev="/dev/sdd"/>
Aug 17 04:08:07 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:08:07 user nova-compute[72793]:   <serial>28f92a50-761e-4606-88d8-e13897b1aebf</serial>
Aug 17 04:08:07 user nova-compute[72793]: </disk>
Aug 17 04:08:07 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-36008b73-550b-4a76-b3d1-9358d764b1c2 req-38616bd7-3c6f-4d40-a721-428766cf66bd service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-36008b73-550b-4a76-b3d1-9358d764b1c2 req-38616bd7-3c6f-4d40-a721-428766cf66bd service nova] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-36008b73-550b-4a76-b3d1-9358d764b1c2 req-38616bd7-3c6f-4d40-a721-428766cf66bd service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-36008b73-550b-4a76-b3d1-9358d764b1c2 req-38616bd7-3c6f-4d40-a721-428766cf66bd service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-36008b73-550b-4a76-b3d1-9358d764b1c2 req-38616bd7-3c6f-4d40-a721-428766cf66bd service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] No waiting events found dispatching network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:07 user nova-compute[72793]: WARNING nova.compute.manager [req-36008b73-550b-4a76-b3d1-9358d764b1c2 req-38616bd7-3c6f-4d40-a721-428766cf66bd service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received unexpected event network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 for instance with vm_state building and task_state spawning.
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245287.520559, 28af729a-94d4-4e5f-ba09-98aa0b85ffed => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] VM Resumed (Lifecycle Event)
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Instance spawned successfully.
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245287.5238545, 28af729a-94d4-4e5f-ba09-98aa0b85ffed => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] VM Started (Lifecycle Event)
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No VIF found with MAC fa:16:3e:8d:a0:36, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.claims [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Claim successful on node user
Aug 17 04:08:07 user nova-compute[72793]: INFO nova.compute.manager [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Took 8.16 seconds to build instance.
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e10b588b-7020-4a65-92a9-b28336331e4b tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.483s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9775be8-ec91-4b20-bfeb-fe05f5ce75a3 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.406s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.088s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:08:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:08:09 user nova-compute[72793]: DEBUG nova.policy [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddc21d6c97ef4b4a982b4011e9ebd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f31f57bb7f4b90b0f9d018a662c6e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:08:09 user nova-compute[72793]: INFO nova.virt.block_device [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Booting with volume b3917248-1333-4826-b941-b7e0ab0c5ced at /dev/vda
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG os_brick.utils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:09 user nova-compute[72793]: INFO nova.compute.manager [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Rescuing
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG nova.network.neutron [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc97aa-6e5c-4f1b-9b9d-9d43f675b1c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[db701f11-a4c1-433c-a5cc-e861b2ce17b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf1b7f3-b0d3-4bc0-87a1-025c6d1fd38d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00f9ee-e3d3-42bf-873c-1e37df876288]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:08:09 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a17f5f-9511-4936-8980-0a7dc497ca4b]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG os_brick.utils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating existing volume attachment record: b252f686-4388-4735-86e1-56d2287b8096 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Successfully created port: e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.581s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-56501ece-884b-49ad-848e-673b3b5256a6 req-b1e8d69a-517f-4c1d-a06c-2000fdb75d5f service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-56501ece-884b-49ad-848e-673b3b5256a6 req-b1e8d69a-517f-4c1d-a06c-2000fdb75d5f service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-56501ece-884b-49ad-848e-673b3b5256a6 req-b1e8d69a-517f-4c1d-a06c-2000fdb75d5f service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-56501ece-884b-49ad-848e-673b3b5256a6 req-b1e8d69a-517f-4c1d-a06c-2000fdb75d5f service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-56501ece-884b-49ad-848e-673b3b5256a6 req-b1e8d69a-517f-4c1d-a06c-2000fdb75d5f service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:11 user nova-compute[72793]: WARNING nova.compute.manager [req-56501ece-884b-49ad-848e-673b3b5256a6 req-b1e8d69a-517f-4c1d-a06c-2000fdb75d5f service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state active and task_state rescuing.
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Successfully updated port: e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'flavor' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:08:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance destroyed successfully.
Aug 17 04:08:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Attempting a stable device rescue
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72793) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:08:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Creating image(s)
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "68e594c7c2a62e2961b3f51d39dcc49cccb10e2e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "68e594c7c2a62e2961b3f51d39dcc49cccb10e2e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:11 user nova-compute[72793]: INFO nova.compute.manager [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attaching volume e40db13c-3240-4450-847b-0977c08ac0b3 to /dev/vdc
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG os_brick.utils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 1.470s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[27332097-6d25-4ed0-8fbe-d8400b076403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing instance network info cache due to event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[196698fc-f541-4329-9292-1213fe974244]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.part --force-share --output=json" returned: 0 in 0.330s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.virt.images [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] ada346b1-6d8a-4684-bb72-d5778e6a95ee was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.part /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6470064a-3028-46c3-b1ee-be6624f3424b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed2a6a8-d80d-4b15-9f8a-c93886d90709]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:08:13 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad688fe9-41fe-4850-8122-1d842e11d74d]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG os_brick.utils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] <== get_connector_properties: return (734ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updating existing volume attachment record: 123ac27f-ce41-48ae-93a9-12bd91897ebd {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance network_info: |[{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245279.1019473, ecbd6261-7b55-4225-97c8-bbd02b37aa5a => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:14 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] VM Stopped (Lifecycle Event)
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-34bdc0be-ce8a-464f-ba17-43b29c9d342a None None] [instance: ecbd6261-7b55-4225-97c8-bbd02b37aa5a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.494s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.part /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.converted" returned: 0 in 1.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updated VIF entry in instance network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:14 user nova-compute[72793]: WARNING nova.compute.manager [req-98389e9d-45ef-4f8a-9598-b06310fee9c6 req-21350a6a-f4e2-4259-a869-a823c072c14d service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state active and task_state rescuing.
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e.converted --force-share --output=json" returned: 0 in 0.272s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "68e594c7c2a62e2961b3f51d39dcc49cccb10e2e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.155s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "68e594c7c2a62e2961b3f51d39dcc49cccb10e2e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "68e594c7c2a62e2961b3f51d39dcc49cccb10e2e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e --force-share --output=json" returned: 0 in 0.251s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e,backing_fmt=raw /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e,backing_fmt=raw /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue" returned: 0 in 0.088s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "68e594c7c2a62e2961b3f51d39dcc49cccb10e2e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'migration_context' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Start _get_guest_xml network_info=[{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "vif_mac": "fa:16:3e:8d:a0:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ada346b1-6d8a-4684-bb72-d5778e6a95ee', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRPqYsIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6c830030-be1e-4aa1-a583-7fb997d51893', 'attached_at': '', 'detached_at': '', 'volume_id': '28f92a50-761e-4606-88d8-e13897b1aebf', 'serial': '28f92a50-761e-4606-88d8-e13897b1aebf'}, 'guest_format': None, 'attachment_id': '16743062-0c8a-47f6-ba19-fe506c08f665', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'resources' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:15 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:15 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRPqYsIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:15 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:15 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:15 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087656f-6db8-4481-b1b3-b281537c63f5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eRPqYsIk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 04:08:15 user nova-compute[72793]: node.name = iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf
Aug 17 04:08:15 user nova-compute[72793]: node.tpgt = -1
Aug 17 04:08:15 user nova-compute[72793]: node.startup = automatic
Aug 17 04:08:15 user nova-compute[72793]: node.leading_login = No
Aug 17 04:08:15 user nova-compute[72793]: iface.iscsi_ifacename = default
Aug 17 04:08:15 user nova-compute[72793]: iface.net_ifacename = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.ipaddress = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.prefix_len = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.hwaddress = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.transport_name = tcp
Aug 17 04:08:15 user nova-compute[72793]: iface.initiatorname = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.vlan_id = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.vlan_priority = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.vlan_state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.iface_num = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.mtu = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.port = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.bootproto = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.subnet_mask = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.gateway = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_alt_client_id = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_dns = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_learn_iqn = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_vendor_id_state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_vendor_id = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.dhcp_slp_da = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.fragmentation = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.gratuitous_arp = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.incoming_forwarding = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.tos_state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.tos = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.ttl = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.delayed_ack = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.tcp_nagle = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.tcp_wsf_state = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.tcp_wsf = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.tcp_timer_scale = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.tcp_timestamp = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.redirect = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.def_task_mgmt_timeout = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.header_digest = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.data_digest = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.immediate_data = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.initial_r2t = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.data_seq_inorder = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.data_pdu_inorder = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.erl = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.max_receive_data_len = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.first_burst_len = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.max_outstanding_r2t = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.max_burst_len = 0
Aug 17 04:08:15 user nova-compute[72793]: iface.chap_auth = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.bidi_chap = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.strict_login_compliance = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.discovery_auth = <empty>
Aug 17 04:08:15 user nova-compute[72793]: iface.discovery_logout = <empty>
Aug 17 04:08:15 user nova-compute[72793]: node.discovery_address = <empty>
Aug 17 04:08:15 user nova-compute[72793]: node.discovery_port = 0
Aug 17 04:08:15 user nova-compute[72793]: node.discovery_type = static
Aug 17 04:08:15 user nova-compute[72793]: node.session.initial_cmdsn = 0
Aug 17 04:08:15 user nova-compute[72793]: node.session.initial_login_retry_max = 8
Aug 17 04:08:15 user nova-compute[72793]: node.session.xmit_thread_priority = -20
Aug 17 04:08:15 user nova-compute[72793]: node.session.cmds_max = 128
Aug 17 04:08:15 user nova-compute[72793]: node.session.queue_depth = 32
Aug 17 04:08:15 user nova-compute[72793]: node.session.nr_sessions = 1
Aug 17 04:08:15 user nova-compute[72793]: node.session.auth.authmethod = CHAP
Aug 17 04:08:15 user nova-compute[72793]: node.session.auth.username = eRPqYsIk
Aug 17 04:08:15 user nova-compute[72793]: node.session.auth.password = ***
Aug 17 04:08:15 user nova-compute[72793]: node.session.auth.username_in = <empty>
Aug 17 04:08:15 user nova-compute[72793]: node.session.auth.password_in = <empty>
Aug 17 04:08:15 user nova-compute[72793]: node.session.auth.chap_algs = MD5
Aug 17 04:08:15 user nova-compute[72793]: node.session.timeo.replacement_timeout = 120
Aug 17 04:08:15 user nova-compute[72793]: node.session.err_timeo.abort_timeout = 15
Aug 17 04:08:15 user nova-compute[72793]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 04:08:15 user nova-compute[72793]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 04:08:15 user nova-compute[72793]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.FastAbort = Yes
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.InitialR2T = No
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.ImmediateData = Yes
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.MaxConnections = 1
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 04:08:15 user nova-compute[72793]: node.session.iscsi.ERL = 0
Aug 17 04:08:15 user nova-compute[72793]: node.session.scan = manual
Aug 17 04:08:15 user nova-compute[72793]: node.session.reopen_max = 0
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].address = 172.16.0.220
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].port = 3260
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].startup = manual
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].tcp.window_size = 524288
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].tcp.type_of_service = 0
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].timeo.logout_timeout = 15
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].timeo.login_timeout = 15
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].timeo.auth_timeout = 45
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].iscsi.DataDigest = None
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].iscsi.IFMarker = No
Aug 17 04:08:15 user nova-compute[72793]: node.conn[0].iscsi.OFMarker = No
Aug 17 04:08:15 user nova-compute[72793]: # END RECORD
Aug 17 04:08:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a29864-9d52-4907-8f3b-d38e9249d93b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a15fb72-bfab-4c5d-8502-fc2ee8368a09]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRPqYsIk {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eRPqYsIk" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3597ea39-734e-49b2-b679-563bbca1403f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eRPqYsIk'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:16 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:16 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7399MB free_disk=25.341243743896484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be4854c-3713-491d-a82d-f84417bcd3b2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[19722239-abf3-43cf-8186-09037a179045]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:16 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:16 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:16 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:16 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:16 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:16 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:16 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:16 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.954s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1606a962-6fc1-450d-8860-224632560652]: (4, ('0 0 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRPqYsIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] <== connect_volume: return (1003ms) {'type': 'block', 'scsi_wwn': '23064646261363936', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064646261363936', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267099843',display_name='tempest-ServerStableDeviceRescueTest-server-1267099843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267099843',id=20,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSM5dElm1GppRv3T2Lvsupvvf5j/KDOnFCs4lE0qN6Bcc0viR6WUM7+FkycjToeoGztWOGAssgzvU4SZTkv61Gg3X14wBlMQdd5/PkUUTFiFp/VW/mKukrQ1hL5DwM8dw==',key_name='tempest-keypair-56794815',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:04:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbcbbda6abba4007a6055ee0f9c01c33',ramdisk_id='',reservation_id='r-i6gy50hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-621052297',owner_user_name='tempest-ServerStableDeviceRescueTest-621052297-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7fa68c3f41e4c07b1026e56ab3b4852',uuid=6c830030-be1e-4aa1-a583-7fb997d51893,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "vif_mac": "fa:16:3e:8d:a0:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converting VIF {"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "vif_mac": "fa:16:3e:8d:a0:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:08:16 user nova-compute[72793]:   <uuid>6c830030-be1e-4aa1-a583-7fb997d51893</uuid>
Aug 17 04:08:16 user nova-compute[72793]:   <name>instance-00000014</name>
Aug 17 04:08:16 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:08:16 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:08:16 user nova-compute[72793]:   <metadata>
Aug 17 04:08:16 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:08:16 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:08:16 user nova-compute[72793]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1267099843</nova:name>
Aug 17 04:08:16 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:08:15</nova:creationTime>
Aug 17 04:08:16 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:08:16 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:08:16 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:08:16 user nova-compute[72793]:       <nova:owner>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:user uuid="b7fa68c3f41e4c07b1026e56ab3b4852">tempest-ServerStableDeviceRescueTest-621052297-project-member</nova:user>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:project uuid="cbcbbda6abba4007a6055ee0f9c01c33">tempest-ServerStableDeviceRescueTest-621052297</nova:project>
Aug 17 04:08:16 user nova-compute[72793]:       </nova:owner>
Aug 17 04:08:16 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:08:16 user nova-compute[72793]:       <nova:ports>
Aug 17 04:08:16 user nova-compute[72793]:         <nova:port uuid="06b66834-5f15-4470-88bd-3bc5fda3c059">
Aug 17 04:08:16 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 04:08:16 user nova-compute[72793]:         </nova:port>
Aug 17 04:08:16 user nova-compute[72793]:       </nova:ports>
Aug 17 04:08:16 user nova-compute[72793]:     </nova:instance>
Aug 17 04:08:16 user nova-compute[72793]:   </metadata>
Aug 17 04:08:16 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:08:16 user nova-compute[72793]:     <system>
Aug 17 04:08:16 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:08:16 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:08:16 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:08:16 user nova-compute[72793]:       <entry name="serial">6c830030-be1e-4aa1-a583-7fb997d51893</entry>
Aug 17 04:08:16 user nova-compute[72793]:       <entry name="uuid">6c830030-be1e-4aa1-a583-7fb997d51893</entry>
Aug 17 04:08:16 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:08:16 user nova-compute[72793]:     </system>
Aug 17 04:08:16 user nova-compute[72793]:   </sysinfo>
Aug 17 04:08:16 user nova-compute[72793]:   <os>
Aug 17 04:08:16 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:08:16 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:08:16 user nova-compute[72793]:   </os>
Aug 17 04:08:16 user nova-compute[72793]:   <features>
Aug 17 04:08:16 user nova-compute[72793]:     <acpi/>
Aug 17 04:08:16 user nova-compute[72793]:     <apic/>
Aug 17 04:08:16 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:08:16 user nova-compute[72793]:   </features>
Aug 17 04:08:16 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:08:16 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:08:16 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:08:16 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:08:16 user nova-compute[72793]:   </clock>
Aug 17 04:08:16 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:08:16 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:08:16 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:08:16 user nova-compute[72793]:   </cpu>
Aug 17 04:08:16 user nova-compute[72793]:   <devices>
Aug 17 04:08:16 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:08:16 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:08:16 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk"/>
Aug 17 04:08:16 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:08:16 user nova-compute[72793]:     </disk>
Aug 17 04:08:16 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:08:16 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:16 user nova-compute[72793]:       <source dev="/dev/sdd"/>
Aug 17 04:08:16 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:08:16 user nova-compute[72793]:       <serial>28f92a50-761e-4606-88d8-e13897b1aebf</serial>
Aug 17 04:08:16 user nova-compute[72793]:     </disk>
Aug 17 04:08:16 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:08:16 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:08:16 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue"/>
Aug 17 04:08:16 user nova-compute[72793]:       <target dev="vdc" bus="virtio"/>
Aug 17 04:08:16 user nova-compute[72793]:       <boot order="1"/>
Aug 17 04:08:16 user nova-compute[72793]:     </disk>
Aug 17 04:08:16 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:08:16 user nova-compute[72793]:       <mac address="fa:16:3e:8d:a0:36"/>
Aug 17 04:08:16 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:08:16 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:08:16 user nova-compute[72793]:       <target dev="tap06b66834-5f"/>
Aug 17 04:08:16 user nova-compute[72793]:     </interface>
Aug 17 04:08:16 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:08:16 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/console.log" append="off"/>
Aug 17 04:08:16 user nova-compute[72793]:     </serial>
Aug 17 04:08:16 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:08:16 user nova-compute[72793]:     <video>
Aug 17 04:08:16 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:08:16 user nova-compute[72793]:     </video>
Aug 17 04:08:16 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:08:16 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:08:16 user nova-compute[72793]:     </rng>
Aug 17 04:08:16 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:08:16 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:08:16 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:08:16 user nova-compute[72793]:     </memballoon>
Aug 17 04:08:16 user nova-compute[72793]:   </devices>
Aug 17 04:08:16 user nova-compute[72793]: </domain>
Aug 17 04:08:16 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:08:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance destroyed successfully.
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4eaa5595-c08e-48a3-a731-66b740d355ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 0caea72b-8769-4feb-ac34-5904ba45308f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d4b8f681-6b81-49fe-8455-7564e2cafff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] No VIF found with MAC fa:16:3e:8d:a0:36, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:17 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:08:17 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:08:17 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:08:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.855s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:17 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-706b74ff-c610-4298-8cb8-1dfac70e718f req-ad15a0f0-d94b-435a-a082-66b8cb0fcd06 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-706b74ff-c610-4298-8cb8-1dfac70e718f req-ad15a0f0-d94b-435a-a082-66b8cb0fcd06 service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-706b74ff-c610-4298-8cb8-1dfac70e718f req-ad15a0f0-d94b-435a-a082-66b8cb0fcd06 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-706b74ff-c610-4298-8cb8-1dfac70e718f req-ad15a0f0-d94b-435a-a082-66b8cb0fcd06 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-706b74ff-c610-4298-8cb8-1dfac70e718f req-ad15a0f0-d94b-435a-a082-66b8cb0fcd06 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:18 user nova-compute[72793]: WARNING nova.compute.manager [req-706b74ff-c610-4298-8cb8-1dfac70e718f req-ad15a0f0-d94b-435a-a082-66b8cb0fcd06 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state active and task_state rescuing.
Aug 17 04:08:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:20 user nova-compute[72793]: INFO nova.compute.manager [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Unrescuing
Aug 17 04:08:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-d6044eb0-3e38-4f98-ae0b-f36839c86179 req-e4726fbd-f715-4e9c-bd56-33ba28848d4e service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d6044eb0-3e38-4f98-ae0b-f36839c86179 req-e4726fbd-f715-4e9c-bd56-33ba28848d4e service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d6044eb0-3e38-4f98-ae0b-f36839c86179 req-e4726fbd-f715-4e9c-bd56-33ba28848d4e service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d6044eb0-3e38-4f98-ae0b-f36839c86179 req-e4726fbd-f715-4e9c-bd56-33ba28848d4e service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-d6044eb0-3e38-4f98-ae0b-f36839c86179 req-e4726fbd-f715-4e9c-bd56-33ba28848d4e service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:20 user nova-compute[72793]: WARNING nova.compute.manager [req-d6044eb0-3e38-4f98-ae0b-f36839c86179 req-e4726fbd-f715-4e9c-bd56-33ba28848d4e service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state active and task_state rescuing.
Aug 17 04:08:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'flavor' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for 6c830030-be1e-4aa1-a583-7fb997d51893 due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245301.0583403, 6c830030-be1e-4aa1-a583-7fb997d51893 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Resumed (Lifecycle Event)
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-bd6ab54e-305b-406d-b009-a7a5a0b41a32 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245301.0596857, 6c830030-be1e-4aa1-a583-7fb997d51893 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:21 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Started (Lifecycle Event)
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-1a1e0483-e5eb-4ef0-b5ef-d7d51cb58b2c req-43b5d180-f83f-4f82-8542-413c1a2c1297 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1a1e0483-e5eb-4ef0-b5ef-d7d51cb58b2c req-43b5d180-f83f-4f82-8542-413c1a2c1297 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1a1e0483-e5eb-4ef0-b5ef-d7d51cb58b2c req-43b5d180-f83f-4f82-8542-413c1a2c1297 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1a1e0483-e5eb-4ef0-b5ef-d7d51cb58b2c req-43b5d180-f83f-4f82-8542-413c1a2c1297 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-1a1e0483-e5eb-4ef0-b5ef-d7d51cb58b2c req-43b5d180-f83f-4f82-8542-413c1a2c1297 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:21 user nova-compute[72793]: WARNING nova.compute.manager [req-1a1e0483-e5eb-4ef0-b5ef-d7d51cb58b2c req-43b5d180-f83f-4f82-8542-413c1a2c1297 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:08:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:21 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance destroyed successfully.
Aug 17 04:08:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-c1e1a29a-f3bd-4833-8e23-5b28d127e513 req-12fde4b6-8597-4825-839c-5d28ac361aec service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c1e1a29a-f3bd-4833-8e23-5b28d127e513 req-12fde4b6-8597-4825-839c-5d28ac361aec service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c1e1a29a-f3bd-4833-8e23-5b28d127e513 req-12fde4b6-8597-4825-839c-5d28ac361aec service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c1e1a29a-f3bd-4833-8e23-5b28d127e513 req-12fde4b6-8597-4825-839c-5d28ac361aec service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-c1e1a29a-f3bd-4833-8e23-5b28d127e513 req-12fde4b6-8597-4825-839c-5d28ac361aec service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:23 user nova-compute[72793]: WARNING nova.compute.manager [req-c1e1a29a-f3bd-4833-8e23-5b28d127e513 req-12fde4b6-8597-4825-839c-5d28ac361aec service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:08:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:25 user nova-compute[72793]: WARNING nova.compute.manager [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:25 user nova-compute[72793]: WARNING nova.compute.manager [req-990ae12f-74f3-4c59-96f9-47a4d2325790 req-2dce7051-453e-442e-9d4a-0ab97bad12e1 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for d3b38fd0-f823-4a39-927a-52c064339731 due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245305.656272, d3b38fd0-f823-4a39-927a-52c064339731 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Resumed (Lifecycle Event)
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a69891cc-0795-440d-aad2-74ae423fe010 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245305.657494, d3b38fd0-f823-4a39-927a-52c064339731 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Started (Lifecycle Event)
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esdQNKWH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:27 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:27 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:27 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a25530-7d53-4f3e-b153-f5fff4921029]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:08:27 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe2065b-6fe8-4e95-9a39-f70c393be5b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3] added
Aug 17 04:08:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493a002-3dbd-49b4-8235-fb9a29e2dcd9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67911d66-bcd8-4f5e-ab26-1870900b6990]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esdQNKWH {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v esdQNKWH" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd60f6-89ec-4d06-92dc-420bac89bc95]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'esdQNKWH'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8615b2-467a-427f-aa90-b0a3efe1c219]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf35c36-ef36-45eb-a628-457beceb26dc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[485666e6-6628-4486-9caa-4722db82a1ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260]
Aug 17 04:08:27 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260] successful.
Aug 17 04:08:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6ce8ab-3cba-4219-b733-5d450492eef5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4492f273-46da-49aa-b7de-31f5dd68d651]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:27 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:27 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dda832c-cdc0-4191-8607-c535312e92aa]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:08:27 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esdQNKWH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:08:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23533663930303533', 'path': '/dev/sde'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533663930303533', 'path': '/dev/sde'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:08:28 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'flavor' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:08:28 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:28 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:08:28 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:08:28 user nova-compute[72793]:   <serial>e40db13c-3240-4450-847b-0977c08ac0b3</serial>
Aug 17 04:08:28 user nova-compute[72793]: </disk>
Aug 17 04:08:28 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:08:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] No VIF found with MAC fa:16:3e:00:57:30, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c81a9e6a-a5fa-4e30-bbf4-e030a5deea85 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.693s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:08:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Creating image(s)
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Ensure instance console log exists: /opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Start _get_guest_xml network_info=[{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4b8f681-6b81-49fe-8455-7564e2cafff7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3917248-1333-4826-b941-b7e0ab0c5ced', 'serial': 'b3917248-1333-4826-b941-b7e0ab0c5ced'}, 'guest_format': None, 'attachment_id': 'b252f686-4388-4735-86e1-56d2287b8096', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:08:30 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:30 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:30 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:30 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:30 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb3755-32d8-4d65-9162-8016e301dd61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:08:30 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b79672-650e-43d6-9233-8e9478b4e88c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced] added
Aug 17 04:08:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f376d3-88ff-40aa-bca5-5ca172511104]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9fce5-b6f4-49ff-b16d-9b6c8382fe40]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnHkowIa {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnHkowIa" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe35e20-8ae0-42b1-b66b-ae23ffd99768]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnHkowIa'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01e765-5546-4ec0-9b34-124649c9c104]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[166202c2-be71-43d3-968b-94563fbabc14]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d022e702-26dd-43ff-8d23-ce51cf8a036f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]
Aug 17 04:08:30 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.
Aug 17 04:08:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb5a870-64f0-4767-937b-c446d10b7fb9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846a0ff-7639-43ff-ad3d-b85b1d12ad4e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:30 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:30 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea67ee9-f51b-44ef-9bcf-846d7f249fb4]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:30 user nova-compute[72793]: INFO nova.compute.manager [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Detaching volume e40db13c-3240-4450-847b-0977c08ac0b3
Aug 17 04:08:31 user nova-compute[72793]: INFO nova.virt.block_device [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attempting to driver detach volume e40db13c-3240-4450-847b-0977c08ac0b3 from mountpoint /dev/vdc
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Attempting to detach device vdc from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:08:31 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:31 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:08:31 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:08:31 user nova-compute[72793]:   <serial>e40db13c-3240-4450-847b-0977c08ac0b3</serial>
Aug 17 04:08:31 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 04:08:31 user nova-compute[72793]: </disk>
Aug 17 04:08:31 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:08:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Successfully detached device vdc from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the persistent domain config.
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:08:31 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:31 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:08:31 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:08:31 user nova-compute[72793]:   <serial>e40db13c-3240-4450-847b-0977c08ac0b3</serial>
Aug 17 04:08:31 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 04:08:31 user nova-compute[72793]: </disk>
Aug 17 04:08:31 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245311.5145195, 17cc3235-4e5d-41de-91ba-8cca63ba2585 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:08:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Successfully detached device vdc from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the live domain config.
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'esdQNKWH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:31 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26138663930326233', 'path': '/dev/sdf'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138663930326233', 'path': '/dev/sdf'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.041s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e06e88-c688-495d-92d8-9ed574b4576b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1324529661',display_name='tempest-TestShelveInstance-server-1324529661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1324529661',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7rbX5FWzGJLg513BkMi0YLwoKTiCYhJOfOK/vSJVxmqVMLntYShoqpiiRRc9m3dLTzcAmIs0KxJOn9BEPcB8Sh6+usS+R6zQjnt1PTMzrkGIXUUFgbEV5jR5m9Z+LRZg==',key_name='tempest-TestShelveInstance-567723049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29f31f57bb7f4b90b0f9d018a662c6e1',ramdisk_id='',reservation_id='r-jb4ngety',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-278994045',owner_user_name='tempest-TestShelveInstance-278994045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:08:09Z,user_data=None,user_id='ddc21d6c97ef4b4a982b4011e9ebd13b',uuid=d4b8f681-6b81-49fe-8455-7564e2cafff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converting VIF {"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'pci_devices' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:08:31 user nova-compute[72793]:   <uuid>d4b8f681-6b81-49fe-8455-7564e2cafff7</uuid>
Aug 17 04:08:31 user nova-compute[72793]:   <name>instance-0000001c</name>
Aug 17 04:08:31 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:08:31 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:08:31 user nova-compute[72793]:   <metadata>
Aug 17 04:08:31 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:08:31 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:08:31 user nova-compute[72793]:       <nova:name>tempest-TestShelveInstance-server-1324529661</nova:name>
Aug 17 04:08:31 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:08:30</nova:creationTime>
Aug 17 04:08:31 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:08:31 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:08:31 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:08:31 user nova-compute[72793]:       <nova:owner>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:user uuid="ddc21d6c97ef4b4a982b4011e9ebd13b">tempest-TestShelveInstance-278994045-project-member</nova:user>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:project uuid="29f31f57bb7f4b90b0f9d018a662c6e1">tempest-TestShelveInstance-278994045</nova:project>
Aug 17 04:08:31 user nova-compute[72793]:       </nova:owner>
Aug 17 04:08:31 user nova-compute[72793]:       <nova:ports>
Aug 17 04:08:31 user nova-compute[72793]:         <nova:port uuid="e765bd5a-bdb6-4f7f-809b-fea1940e60b2">
Aug 17 04:08:31 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:08:31 user nova-compute[72793]:         </nova:port>
Aug 17 04:08:31 user nova-compute[72793]:       </nova:ports>
Aug 17 04:08:31 user nova-compute[72793]:     </nova:instance>
Aug 17 04:08:31 user nova-compute[72793]:   </metadata>
Aug 17 04:08:31 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:08:31 user nova-compute[72793]:     <system>
Aug 17 04:08:31 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:08:31 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:08:31 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:08:31 user nova-compute[72793]:       <entry name="serial">d4b8f681-6b81-49fe-8455-7564e2cafff7</entry>
Aug 17 04:08:31 user nova-compute[72793]:       <entry name="uuid">d4b8f681-6b81-49fe-8455-7564e2cafff7</entry>
Aug 17 04:08:31 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:08:31 user nova-compute[72793]:     </system>
Aug 17 04:08:31 user nova-compute[72793]:   </sysinfo>
Aug 17 04:08:31 user nova-compute[72793]:   <os>
Aug 17 04:08:31 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:08:31 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:08:31 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:08:31 user nova-compute[72793]:   </os>
Aug 17 04:08:31 user nova-compute[72793]:   <features>
Aug 17 04:08:31 user nova-compute[72793]:     <acpi/>
Aug 17 04:08:31 user nova-compute[72793]:     <apic/>
Aug 17 04:08:31 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:08:31 user nova-compute[72793]:   </features>
Aug 17 04:08:31 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:08:31 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:08:31 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:08:31 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:08:31 user nova-compute[72793]:   </clock>
Aug 17 04:08:31 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:08:31 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:08:31 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:08:31 user nova-compute[72793]:   </cpu>
Aug 17 04:08:31 user nova-compute[72793]:   <devices>
Aug 17 04:08:31 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:08:31 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:31 user nova-compute[72793]:       <source dev="/dev/sdf"/>
Aug 17 04:08:31 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:08:31 user nova-compute[72793]:       <serial>b3917248-1333-4826-b941-b7e0ab0c5ced</serial>
Aug 17 04:08:31 user nova-compute[72793]:     </disk>
Aug 17 04:08:31 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:08:31 user nova-compute[72793]:       <mac address="fa:16:3e:e7:cb:49"/>
Aug 17 04:08:31 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:08:31 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:08:31 user nova-compute[72793]:       <target dev="tape765bd5a-bd"/>
Aug 17 04:08:31 user nova-compute[72793]:     </interface>
Aug 17 04:08:31 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:08:31 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7/console.log" append="off"/>
Aug 17 04:08:31 user nova-compute[72793]:     </serial>
Aug 17 04:08:31 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:08:31 user nova-compute[72793]:     <video>
Aug 17 04:08:31 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:08:31 user nova-compute[72793]:     </video>
Aug 17 04:08:31 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:08:31 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:08:31 user nova-compute[72793]:     </rng>
Aug 17 04:08:31 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:08:31 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:08:31 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:08:31 user nova-compute[72793]:     </memballoon>
Aug 17 04:08:31 user nova-compute[72793]:   </devices>
Aug 17 04:08:31 user nova-compute[72793]: </domain>
Aug 17 04:08:31 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1324529661',display_name='tempest-TestShelveInstance-server-1324529661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1324529661',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7rbX5FWzGJLg513BkMi0YLwoKTiCYhJOfOK/vSJVxmqVMLntYShoqpiiRRc9m3dLTzcAmIs0KxJOn9BEPcB8Sh6+usS+R6zQjnt1PTMzrkGIXUUFgbEV5jR5m9Z+LRZg==',key_name='tempest-TestShelveInstance-567723049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29f31f57bb7f4b90b0f9d018a662c6e1',ramdisk_id='',reservation_id='r-jb4ngety',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-278994045',owner_user_name='tempest-TestShelveInstance-278994045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:08:09Z,user_data=None,user_id='ddc21d6c97ef4b4a982b4011e9ebd13b',uuid=d4b8f681-6b81-49fe-8455-7564e2cafff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converting VIF {"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_vif [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape765bd5a-bd, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape765bd5a-bd, col_values=(('external_ids', {'iface-id': 'e765bd5a-bdb6-4f7f-809b-fea1940e60b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:cb:49', 'vm-uuid': 'd4b8f681-6b81-49fe-8455-7564e2cafff7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc0af6d-eb7d-464f-8ac5-0edf968b4f15]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 (non-flash)
Aug 17 04:08:31 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07b8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3'): ({'sde'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Removing single pathed devices sde {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:31 user nova-compute[72793]: INFO os_vif [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd')
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb9b42-bdaf-47f2-8690-12954fc0a8dc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f1f4ac-c554-4428-af46-54b3b8e17864]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Flushing IO for device /dev/sde {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] No VIF found with MAC fa:16:3e:e7:cb:49, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb725fa-999d-441a-bb2d-b995233b73b8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[541a4eda-2a87-432b-8d61-25b991147ce7]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[157cc2a2-6944-4dca-ad04-d1f9658d1cb8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdcaad6-12e2-4abe-8382-3caec7518a56]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260]
Aug 17 04:08:31 user nova-compute[72793]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3, portal: 172.16.0.220,3260] successful.
Aug 17 04:08:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e40db13c-3240-4450-847b-0977c08ac0b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3998202-6c7b-4604-a32c-84f3a96bb3b5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] <== disconnect_volume: return (376ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-8c2cee81-7492-47d0-85b9-0097b58db16a req-e16ee276-8ec3-44a8-9163-6474ed92baf9 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8c2cee81-7492-47d0-85b9-0097b58db16a req-e16ee276-8ec3-44a8-9163-6474ed92baf9 service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8c2cee81-7492-47d0-85b9-0097b58db16a req-e16ee276-8ec3-44a8-9163-6474ed92baf9 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8c2cee81-7492-47d0-85b9-0097b58db16a req-e16ee276-8ec3-44a8-9163-6474ed92baf9 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-8c2cee81-7492-47d0-85b9-0097b58db16a req-e16ee276-8ec3-44a8-9163-6474ed92baf9 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:33 user nova-compute[72793]: WARNING nova.compute.manager [req-8c2cee81-7492-47d0-85b9-0097b58db16a req-e16ee276-8ec3-44a8-9163-6474ed92baf9 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state building and task_state spawning.
Aug 17 04:08:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'flavor' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1e8da9b6-740a-48ad-9137-2f575660bf99 tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.575s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-cbb673eb-1587-4970-b56b-263f2c51870d req-ebd3f190-5593-438b-97ce-25977ebf94b7 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cbb673eb-1587-4970-b56b-263f2c51870d req-ebd3f190-5593-438b-97ce-25977ebf94b7 service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cbb673eb-1587-4970-b56b-263f2c51870d req-ebd3f190-5593-438b-97ce-25977ebf94b7 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cbb673eb-1587-4970-b56b-263f2c51870d req-ebd3f190-5593-438b-97ce-25977ebf94b7 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-cbb673eb-1587-4970-b56b-263f2c51870d req-ebd3f190-5593-438b-97ce-25977ebf94b7 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:08:35 user nova-compute[72793]: WARNING nova.compute.manager [req-cbb673eb-1587-4970-b56b-263f2c51870d req-ebd3f190-5593-438b-97ce-25977ebf94b7 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state building and task_state spawning.
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245315.4362204, d4b8f681-6b81-49fe-8455-7564e2cafff7 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] VM Resumed (Lifecycle Event)
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance spawned successfully.
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245315.4503434, d4b8f681-6b81-49fe-8455-7564e2cafff7 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] VM Started (Lifecycle Event)
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 17 04:08:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:08:35 user nova-compute[72793]: INFO nova.compute.manager [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Took 28.00 seconds to build instance.
Aug 17 04:08:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8453d7dd-ed58-46ad-9d7d-507e2b83cde2 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.129s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-changed-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Refreshing instance network info cache due to event network-changed-135dd33e-b492-45d6-91c9-bdc9318edac4. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] Acquiring lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] Acquired lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.network.neutron [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Refreshing network info cache for port 135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'flavor' on Instance uuid 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Ignoring supplied device name: /dev/vdb
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:08:40 user nova-compute[72793]: INFO nova.compute.manager [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Attaching volume 1baec419-881a-4c4b-82c6-aaef288faf9a to /dev/vdb
Aug 17 04:08:40 user nova-compute[72793]: DEBUG os_brick.utils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc9d27-6f3e-4d3d-b9ca-f4a926a23922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[980231e6-2774-4fb3-a2af-ad066b2d2a8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ffdc43-3366-4e38-a986-01cd8c9d6e83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec70ed-589a-4a1e-a43d-f31c3348ae69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:08:40 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a126b1e-febf-4f99-9618-101cdd205727]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG os_brick.utils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updating existing volume attachment record: 223113f2-02bc-4e42-a525-68767f890c27 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.network.neutron [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updated VIF entry in instance network info cache for port 135dd33e-b492-45d6-91c9-bdc9318edac4. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG nova.network.neutron [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updating instance_info_cache with network_info: [{"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:08:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f31dc018-cbb3-47c6-ab36-e6e22f8bed88 req-6b88f880-4061-4b3a-aeca-ef2e02fab80d service nova] Releasing lock "refresh_cache-4eaa5595-c08e-48a3-a731-66b740d355ab" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:08:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oylNTidG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:08:53 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:53 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:08:53 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebbead8-e431-4884-b9cd-4ccb15429360]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:08:53 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b3b65-de7b-4683-9b89-8ecc13489ace]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a] added
Aug 17 04:08:53 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fcd4e1-f21c-41bb-baf9-d5ec01d1eb1f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e89227f-8106-4f8a-8960-b5e256ab8f59]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oylNTidG {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oylNTidG" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f16331-b464-4c7b-b6cc-7ac7a3f65b40]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oylNTidG'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f3dcd-ca27-41d2-9f37-b67ec5e9fda1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca6f8c-a878-4c85-8e8d-f6e5e6e494c8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:53 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:53 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f457b0-69d5-4724-b1c5-1b36708a62d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260]
Aug 17 04:08:53 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260] successful.
Aug 17 04:08:53 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9399ed5-4657-44f2-b61a-db2ae515e7ec]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ab47e-a362-4e34-ac33-4db045b9d7d2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:08:53 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:08:53 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:08:53 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c539e7f-6079-4b58-8bd0-48ab734735c2]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:08:53 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oylNTidG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:08:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:08:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23638336561323530', 'path': '/dev/sde'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:08:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638336561323530', 'path': '/dev/sde'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:08:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'flavor' on Instance uuid 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:08:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:08:54 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:08:54 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:08:54 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:08:54 user nova-compute[72793]:   <serial>1baec419-881a-4c4b-82c6-aaef288faf9a</serial>
Aug 17 04:08:54 user nova-compute[72793]: </disk>
Aug 17 04:08:54 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:08:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:08:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] No VIF found with MAC fa:16:3e:95:c3:42, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:08:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9966d8f3-ecc2-46e9-8d45-aa2cbf7e624b tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.467s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:08:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:08:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:05 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:09:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:09:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:09:12 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:09:12 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:09:12 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7034MB free_disk=25.204547882080078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4eaa5595-c08e-48a3-a731-66b740d355ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 0caea72b-8769-4feb-ac34-5904ba45308f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d4b8f681-6b81-49fe-8455-7564e2cafff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:09:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:09:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:09:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:21 user nova-compute[72793]: INFO nova.compute.manager [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Detaching volume a25dc2d1-5089-437b-97c5-10a0b75d98f4
Aug 17 04:09:21 user nova-compute[72793]: INFO nova.virt.block_device [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Attempting to driver detach volume a25dc2d1-5089-437b-97c5-10a0b75d98f4 from mountpoint /dev/vdb
Aug 17 04:09:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Attempting to detach device vdb from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:09:21 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:09:21 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:09:21 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:09:21 user nova-compute[72793]:   <serial>a25dc2d1-5089-437b-97c5-10a0b75d98f4</serial>
Aug 17 04:09:21 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:09:21 user nova-compute[72793]: </disk>
Aug 17 04:09:21 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:09:21 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Successfully detached device vdb from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the persistent domain config.
Aug 17 04:09:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:09:21 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:09:21 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:09:21 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:09:21 user nova-compute[72793]:   <serial>a25dc2d1-5089-437b-97c5-10a0b75d98f4</serial>
Aug 17 04:09:21 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:09:21 user nova-compute[72793]: </disk>
Aug 17 04:09:21 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:09:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245362.0426154, 17cc3235-4e5d-41de-91ba-8cca63ba2585 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:09:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Successfully detached device vdb from instance 17cc3235-4e5d-41de-91ba-8cca63ba2585 from the live domain config.
Aug 17 04:09:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMrlaFRw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:09:22 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca03a4-0c7e-47a7-84d5-ebd46151cc38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a61d4-1801-4d89-90ba-2350b2a39dbf]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:09:22 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:22 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:09:22 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d07b8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be5f220-17a5-49b3-ae49-5e6c2ed86136]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5182077-4289-418a-b837-50f4fd490915]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33895be7-351c-48c2-bb06-ee579c8e8a87]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a050569-51ec-4b0d-95f6-f080545a2364]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab1e70d-0b45-4979-bc60-e89bad0ab5ef]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95acf23-8213-41dd-b76e-8e9abafce1b7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260]
Aug 17 04:09:22 user nova-compute[72793]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4, portal: 172.16.0.220,3260] successful.
Aug 17 04:09:22 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a25dc2d1-5089-437b-97c5-10a0b75d98f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648a018-426a-4a6a-9aa1-fb24a8fe0c3d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] <== disconnect_volume: return (345ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:09:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:09:23 user nova-compute[72793]: DEBUG nova.objects.instance [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'flavor' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:09:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-13d30b86-2284-491d-a961-aeeb3785e00b tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.921s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:24 user nova-compute[72793]: INFO nova.compute.manager [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Detaching volume 91b284eb-7f3c-4321-b2dd-b68999e283e7
Aug 17 04:09:24 user nova-compute[72793]: INFO nova.virt.block_device [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Attempting to driver detach volume 91b284eb-7f3c-4321-b2dd-b68999e283e7 from mountpoint /dev/vdc
Aug 17 04:09:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Attempting to detach device vdc from instance 0caea72b-8769-4feb-ac34-5904ba45308f from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:09:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:09:24 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:09:24 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:09:24 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:09:24 user nova-compute[72793]:   <serial>91b284eb-7f3c-4321-b2dd-b68999e283e7</serial>
Aug 17 04:09:24 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:09:24 user nova-compute[72793]: </disk>
Aug 17 04:09:24 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:09:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully detached device vdc from instance 0caea72b-8769-4feb-ac34-5904ba45308f from the persistent domain config.
Aug 17 04:09:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0caea72b-8769-4feb-ac34-5904ba45308f from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:09:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:09:24 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:09:24 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:09:24 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:09:24 user nova-compute[72793]:   <serial>91b284eb-7f3c-4321-b2dd-b68999e283e7</serial>
Aug 17 04:09:24 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:09:24 user nova-compute[72793]: </disk>
Aug 17 04:09:24 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245365.1391406, 0caea72b-8769-4feb-ac34-5904ba45308f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:09:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully detached device vdc from instance 0caea72b-8769-4feb-ac34-5904ba45308f from the live domain config.
Aug 17 04:09:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQiqfCpd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:09:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c6bedb-fb10-4365-91f3-04064959d77b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead60e5e-e2c3-41f5-9449-c70c934db778]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:09:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:25 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:09:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98ffe68940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db22f4-e2eb-43e2-a777-b8c5fccad4a1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e7f3f5-ce49-4864-8b49-d3343ff39946]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c5d28-9bbe-4abf-b0b3-52f7b40e2964]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[96283664-2b9a-4cd1-a762-327dfe640e51]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e964e677-aca4-494f-8c4b-7a7a772bd60d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dfee98-7b18-4870-944b-24a3f1bf922f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260]
Aug 17 04:09:25 user nova-compute[72793]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7, portal: 172.16.0.220,3260] successful.
Aug 17 04:09:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91b284eb-7f3c-4321-b2dd-b68999e283e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada985dc-57f9-4769-a5e2-3d019c2c0f5b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] <== disconnect_volume: return (292ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:09:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:09:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'flavor' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:09:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d8f922c-f2cb-4d31-849d-9138dfd30820 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.747s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:31 user nova-compute[72793]: INFO nova.compute.manager [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Detaching volume 1baec419-881a-4c4b-82c6-aaef288faf9a
Aug 17 04:09:31 user nova-compute[72793]: INFO nova.virt.block_device [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Attempting to driver detach volume 1baec419-881a-4c4b-82c6-aaef288faf9a from mountpoint /dev/vdb
Aug 17 04:09:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Attempting to detach device vdb from instance 4eaa5595-c08e-48a3-a731-66b740d355ab from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:09:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:09:31 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:09:31 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:09:31 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:09:31 user nova-compute[72793]:   <serial>1baec419-881a-4c4b-82c6-aaef288faf9a</serial>
Aug 17 04:09:31 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:09:31 user nova-compute[72793]: </disk>
Aug 17 04:09:31 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:09:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully detached device vdb from instance 4eaa5595-c08e-48a3-a731-66b740d355ab from the persistent domain config.
Aug 17 04:09:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4eaa5595-c08e-48a3-a731-66b740d355ab from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:09:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:09:31 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:09:31 user nova-compute[72793]:   <source dev="/dev/sde"/>
Aug 17 04:09:31 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:09:31 user nova-compute[72793]:   <serial>1baec419-881a-4c4b-82c6-aaef288faf9a</serial>
Aug 17 04:09:31 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:09:31 user nova-compute[72793]: </disk>
Aug 17 04:09:31 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:09:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245372.259438, 4eaa5595-c08e-48a3-a731-66b740d355ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:09:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully detached device vdb from instance 4eaa5595-c08e-48a3-a731-66b740d355ab from the live domain config.
Aug 17 04:09:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oylNTidG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:09:32 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[164cab98-874a-4ade-8c2e-2c9ffae949a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d0b886-5771-4ede-aa4e-38bfb513d7fb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:32 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:32 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:32 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:09:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:32 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:32 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:32 user nova-compute[72793]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a (non-flash)
Aug 17 04:09:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d06884c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a'): ({'sde'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Removing single pathed devices sde {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31c5eed-d282-4748-a9c0-e0c0db31d797]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cea9657-6f1d-45c0-8749-1b43873da715]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Flushing IO for device /dev/sde {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e7353-89ba-489c-a3f1-66b8a3515ab1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac6aa36-c3a3-4977-ac45-5e5cccd65f0a]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] SCSI volumes sde have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e924e9-744c-4e6e-b70a-786328a5861e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea5b9c1-ac3d-4a79-9d8e-b3655e539a5b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260]
Aug 17 04:09:32 user nova-compute[72793]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a, portal: 172.16.0.220,3260] successful.
Aug 17 04:09:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b9c32e-4db2-474c-ad43-e6b648c81566]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== disconnect_volume: return (282ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:09:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'flavor' on Instance uuid 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-66139982-aa9f-418f-941a-cbfcf3844137 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.518s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:33 user nova-compute[72793]: INFO nova.compute.manager [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Terminating instance
Aug 17 04:09:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-f7ce4adc-5203-4f04-a776-0ab69ddce17f req-7210bd84-848a-41a6-a9d3-717f4b22543d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-vif-unplugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f7ce4adc-5203-4f04-a776-0ab69ddce17f req-7210bd84-848a-41a6-a9d3-717f4b22543d service nova] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f7ce4adc-5203-4f04-a776-0ab69ddce17f req-7210bd84-848a-41a6-a9d3-717f4b22543d service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f7ce4adc-5203-4f04-a776-0ab69ddce17f req-7210bd84-848a-41a6-a9d3-717f4b22543d service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-f7ce4adc-5203-4f04-a776-0ab69ddce17f req-7210bd84-848a-41a6-a9d3-717f4b22543d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] No waiting events found dispatching network-vif-unplugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:09:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-f7ce4adc-5203-4f04-a776-0ab69ddce17f req-7210bd84-848a-41a6-a9d3-717f4b22543d service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-vif-unplugged-135dd33e-b492-45d6-91c9-bdc9318edac4 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Instance destroyed successfully.
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lazy-loading 'resources' on Instance uuid 4eaa5595-c08e-48a3-a731-66b740d355ab {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2002050548',display_name='tempest-VolumesSnapshotTestJSON-instance-2002050548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2002050548',id=26,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRUR7ze9lq06kAXJmDC54BQk1ldVivBf6T2H1rb/vvolkJYREyXjppLpVyEuE19Y3+1cyMcwjSLgexdY0xVu5/14Dh59v1+NOaSK/PSi/wdB1GCcF1V3Nq2f+U23QHXyQ==',key_name='tempest-keypair-1570946757',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bee286a962408b835f909f54ed13c1',ramdisk_id='',reservation_id='r-60ntqx1x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1354726728',owner_user_name='tempest-VolumesSnapshotTestJSON-1354726728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:06:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ab04a3f7b5a49a18611842d9b17caee',uuid=4eaa5595-c08e-48a3-a731-66b740d355ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converting VIF {"id": "135dd33e-b492-45d6-91c9-bdc9318edac4", "address": "fa:16:3e:95:c3:42", "network": {"id": "93377fd7-7504-4544-99ba-2da5441fe4ff", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-299515050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bee286a962408b835f909f54ed13c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135dd33e-b4", "ovs_interfaceid": "135dd33e-b492-45d6-91c9-bdc9318edac4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_vif [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap135dd33e-b4, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:09:34 user nova-compute[72793]: INFO os_vif [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:c3:42,bridge_name='br-int',has_traffic_filtering=True,id=135dd33e-b492-45d6-91c9-bdc9318edac4,network=Network(93377fd7-7504-4544-99ba-2da5441fe4ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135dd33e-b4')
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oylNTidG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:09:34 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1baec419-881a-4c4b-82c6-aaef288faf9a', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c568c-84a8-423e-89c8-d02d99edf4c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd4ed8-c504-4e9b-905f-0bae17513e0c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:34 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:34 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:34 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:09:34 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:09:34 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:09:34 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02c8d30>, {}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Disconnecting from: [] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] <== disconnect_volume: return (52ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:09:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Deleting instance files /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab_del
Aug 17 04:09:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Deletion of /opt/stack/data/nova/instances/4eaa5595-c08e-48a3-a731-66b740d355ab_del complete
Aug 17 04:09:34 user nova-compute[72793]: INFO nova.compute.manager [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 04:09:34 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:09:34 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:09:35 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Took 1.15 seconds to deallocate network for instance.
Aug 17 04:09:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-c188c70b-8862-4cac-b7ac-26e3b2bed87e req-45e1f446-5861-496f-9ee0-27f4a09418e9 service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-vif-deleted-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:09:35 user nova-compute[72793]: WARNING nova.volume.cinder [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Attachment 223113f2-02bc-4e42-a525-68767f890c27 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 223113f2-02bc-4e42-a525-68767f890c27. (HTTP 404) (Request-ID: req-3b3049e8-2046-44ea-9699-da8277d8c54a)
Aug 17 04:09:35 user nova-compute[72793]: INFO nova.compute.manager [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Took 0.02 seconds to detach 1 volumes for instance.
Aug 17 04:09:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-a66845bc-22c4-454c-bc41-416a77f7b7c5 req-3a33955e-c15a-4e02-b6ea-c0227d15ac6b service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received event network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a66845bc-22c4-454c-bc41-416a77f7b7c5 req-3a33955e-c15a-4e02-b6ea-c0227d15ac6b service nova] Acquiring lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a66845bc-22c4-454c-bc41-416a77f7b7c5 req-3a33955e-c15a-4e02-b6ea-c0227d15ac6b service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a66845bc-22c4-454c-bc41-416a77f7b7c5 req-3a33955e-c15a-4e02-b6ea-c0227d15ac6b service nova] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-a66845bc-22c4-454c-bc41-416a77f7b7c5 req-3a33955e-c15a-4e02-b6ea-c0227d15ac6b service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] No waiting events found dispatching network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:09:35 user nova-compute[72793]: WARNING nova.compute.manager [req-a66845bc-22c4-454c-bc41-416a77f7b7c5 req-3a33955e-c15a-4e02-b6ea-c0227d15ac6b service nova] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Received unexpected event network-vif-plugged-135dd33e-b492-45d6-91c9-bdc9318edac4 for instance with vm_state deleted and task_state None.
Aug 17 04:09:35 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:09:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:35 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Deleted allocations for instance 4eaa5595-c08e-48a3-a731-66b740d355ab
Aug 17 04:09:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c404b0ab-2b14-4023-8cb5-f334e4ac8406 tempest-VolumesSnapshotTestJSON-1354726728 tempest-VolumesSnapshotTestJSON-1354726728-project-member] Lock "4eaa5595-c08e-48a3-a731-66b740d355ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.640s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:09:49 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245374.1775897, 4eaa5595-c08e-48a3-a731-66b740d355ab => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:09:49 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] VM Stopped (Lifecycle Event)
Aug 17 04:09:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2da89417-7e2f-49a4-8613-b84ee9312ee8 None None] [instance: 4eaa5595-c08e-48a3-a731-66b740d355ab] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:09:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:09:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'flavor' on Instance uuid 28af729a-94d4-4e5f-ba09-98aa0b85ffed {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:09:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:09:55 user nova-compute[72793]: INFO nova.compute.manager [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Attaching volume 2f7c45ec-b150-44d7-aeed-0063561c86c5 to /dev/vdb
Aug 17 04:09:55 user nova-compute[72793]: DEBUG os_brick.utils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62334ae-d0db-412b-b9de-970ab5510c3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3864a2d6-5e66-4a99-9677-14eec6ffe741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaae01bb-87ab-4bfa-b2dd-5c6ed1ff5639]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67238d14-61da-4705-8395-7f483653d076]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:09:55 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:09:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacaa5b2-49a1-43a5-a227-1afc896095bb]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG os_brick.utils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:09:55 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Updating existing volume attachment record: bf8b382f-ab5c-48c5-96c5-8e96139e70ed {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:09:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing instance network info cache due to event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:10:00 user nova-compute[72793]: INFO nova.compute.manager [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Unrescuing
Aug 17 04:10:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:00 user nova-compute[72793]: INFO nova.compute.manager [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Shelve offloading
Aug 17 04:10:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updated VIF entry in instance network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59e162a3-47f9-4d8b-98ed-43c0436d309f req-5aba1288-fe45-44b7-aada-42e12796e5eb service nova] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'flavor' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:10:01 user nova-compute[72793]: INFO nova.compute.claims [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Claim successful on node user
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing instance network info cache due to event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:10:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance destroyed successfully.
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.839s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:10:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance destroyed successfully.
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:10:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:10:02 user nova-compute[72793]: INFO nova.virt.block_device [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Booting with volume 06eeb596-a6d1-4bd6-b628-8ef789462193 at /dev/vda
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.policy [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65891e5eae334ee38675df619856db02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c6b688c6c95499ab90009d73f378a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG os_brick.utils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dfe914-1ab1-46b9-af00-46e5f773b79b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873c974-6b86-44fc-95d7-1a886d0b2139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9861f-837e-4f0d-a115-c449b8144a16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a68afdb-fde6-4ccd-9fff-b6c777277889]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:10:02 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:10:02 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd5588-f5ae-40c9-92cc-29f08df90cab]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG os_brick.utils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:10:02 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating existing volume attachment record: 9c92777f-de57-4f26-a356-038b11d5423b {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:03 user nova-compute[72793]: WARNING nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state active and task_state shelving.
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:03 user nova-compute[72793]: WARNING nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state active and task_state shelving.
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:03 user nova-compute[72793]: WARNING nova.compute.manager [req-6a38f4c9-2af9-4bd8-bc02-4c6cafe4eafd req-c8b569f1-737e-488f-a541-823e7a5145ce service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updated VIF entry in instance network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7f92e12c-5576-4593-8f7f-a79f4fdde07c req-88eedfcb-83b6-48df-aa6d-e8a68744f757 service nova] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:03 user nova-compute[72793]: INFO nova.compute.manager [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Rescuing
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Successfully created port: 136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing instance network info cache due to event network-changed-06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Refreshing network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance destroyed successfully.
Aug 17 04:10:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Attempting rescue
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72793) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:10:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Creating image(s)
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-871fd19a-b834-4793-8728-9c1b95d8f8a1 req-7164c413-c265-4ca3-b3a5-0f76686a8ed3 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-871fd19a-b834-4793-8728-9c1b95d8f8a1 req-7164c413-c265-4ca3-b3a5-0f76686a8ed3 service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-871fd19a-b834-4793-8728-9c1b95d8f8a1 req-7164c413-c265-4ca3-b3a5-0f76686a8ed3 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-871fd19a-b834-4793-8728-9c1b95d8f8a1 req-7164c413-c265-4ca3-b3a5-0f76686a8ed3 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-871fd19a-b834-4793-8728-9c1b95d8f8a1 req-7164c413-c265-4ca3-b3a5-0f76686a8ed3 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:05 user nova-compute[72793]: WARNING nova.compute.manager [req-871fd19a-b834-4793-8728-9c1b95d8f8a1 req-7164c413-c265-4ca3-b3a5-0f76686a8ed3 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state active and task_state shelving.
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:05 user nova-compute[72793]: WARNING nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:05 user nova-compute[72793]: WARNING nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state active and task_state shelving.
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:05 user nova-compute[72793]: WARNING nova.compute.manager [req-7a87632f-08cb-43ac-bb2b-81343a3dd105 req-82fb82df-9b4f-4cc7-b8b2-d2914163948f service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state active and task_state shelving.
Aug 17 04:10:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance destroyed successfully.
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'resources' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.221s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1324529661',display_name='tempest-TestShelveInstance-server-1324529661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1324529661',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7rbX5FWzGJLg513BkMi0YLwoKTiCYhJOfOK/vSJVxmqVMLntYShoqpiiRRc9m3dLTzcAmIs0KxJOn9BEPcB8Sh6+usS+R6zQjnt1PTMzrkGIXUUFgbEV5jR5m9Z+LRZg==',key_name='tempest-TestShelveInstance-567723049',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29f31f57bb7f4b90b0f9d018a662c6e1',ramdisk_id='',reservation_id='r-jb4ngety',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-278994045',owner_user_name='tempest-TestShelveInstance-278994045-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:08:36Z,user_data=None,user_id='ddc21d6c97ef4b4a982b4011e9ebd13b',uuid=d4b8f681-6b81-49fe-8455-7564e2cafff7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converting VIF {"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_vif [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape765bd5a-bd, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue" returned: 0 in 0.081s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'migration_context' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Start _get_guest_xml network_info=[{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:5c:37:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'resources' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:05 user nova-compute[72793]: INFO os_vif [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd')
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:10:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'numa_topology' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[197e90a6-4dc2-4449-8bd9-002a2f677826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Successfully updated port: 136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca13558-8ff0-449e-9b88-4c36b9290db0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126366052',display_name='tempest-ServerRescueNegativeTestJSON-server-126366052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126366052',id=23,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-vbayucpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:05:24Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=fc597951-d11b-4e35-8ee5-1f35c14c37eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:5c:37:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:5c:37:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'pci_devices' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:05 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:05 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:10:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:05 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:05 user nova-compute[72793]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:10:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02df490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'): ({'sdf'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Removing single pathed devices sdf {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquired lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:10:05 user nova-compute[72793]:   <uuid>fc597951-d11b-4e35-8ee5-1f35c14c37eb</uuid>
Aug 17 04:10:05 user nova-compute[72793]:   <name>instance-00000017</name>
Aug 17 04:10:05 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:10:05 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:10:05 user nova-compute[72793]:   <metadata>
Aug 17 04:10:05 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:10:05 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:10:05 user nova-compute[72793]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-126366052</nova:name>
Aug 17 04:10:05 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:10:05</nova:creationTime>
Aug 17 04:10:05 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:10:05 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:10:05 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:10:05 user nova-compute[72793]:       <nova:owner>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:user uuid="cbad450f600b4d0aac294be4cd145fa5">tempest-ServerRescueNegativeTestJSON-1617582959-project-member</nova:user>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:project uuid="fba66a3ba645414983fd9fa888e734c9">tempest-ServerRescueNegativeTestJSON-1617582959</nova:project>
Aug 17 04:10:05 user nova-compute[72793]:       </nova:owner>
Aug 17 04:10:05 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:10:05 user nova-compute[72793]:       <nova:ports>
Aug 17 04:10:05 user nova-compute[72793]:         <nova:port uuid="1c674004-09d6-41ac-8e81-57fbc1c33254">
Aug 17 04:10:05 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 04:10:05 user nova-compute[72793]:         </nova:port>
Aug 17 04:10:05 user nova-compute[72793]:       </nova:ports>
Aug 17 04:10:05 user nova-compute[72793]:     </nova:instance>
Aug 17 04:10:05 user nova-compute[72793]:   </metadata>
Aug 17 04:10:05 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:10:05 user nova-compute[72793]:     <system>
Aug 17 04:10:05 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:10:05 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:10:05 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:10:05 user nova-compute[72793]:       <entry name="serial">fc597951-d11b-4e35-8ee5-1f35c14c37eb</entry>
Aug 17 04:10:05 user nova-compute[72793]:       <entry name="uuid">fc597951-d11b-4e35-8ee5-1f35c14c37eb</entry>
Aug 17 04:10:05 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:10:05 user nova-compute[72793]:     </system>
Aug 17 04:10:05 user nova-compute[72793]:   </sysinfo>
Aug 17 04:10:05 user nova-compute[72793]:   <os>
Aug 17 04:10:05 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:10:05 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:10:05 user nova-compute[72793]:   </os>
Aug 17 04:10:05 user nova-compute[72793]:   <features>
Aug 17 04:10:05 user nova-compute[72793]:     <acpi/>
Aug 17 04:10:05 user nova-compute[72793]:     <apic/>
Aug 17 04:10:05 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:10:05 user nova-compute[72793]:   </features>
Aug 17 04:10:05 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:10:05 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:10:05 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:10:05 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:10:05 user nova-compute[72793]:   </clock>
Aug 17 04:10:05 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:10:05 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:10:05 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:10:05 user nova-compute[72793]:   </cpu>
Aug 17 04:10:05 user nova-compute[72793]:   <devices>
Aug 17 04:10:05 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:10:05 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:10:05 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue"/>
Aug 17 04:10:05 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:10:05 user nova-compute[72793]:     </disk>
Aug 17 04:10:05 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:10:05 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:10:05 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk"/>
Aug 17 04:10:05 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:10:05 user nova-compute[72793]:     </disk>
Aug 17 04:10:05 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:10:05 user nova-compute[72793]:       <mac address="fa:16:3e:5c:37:bd"/>
Aug 17 04:10:05 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:10:05 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:10:05 user nova-compute[72793]:       <target dev="tap1c674004-09"/>
Aug 17 04:10:05 user nova-compute[72793]:     </interface>
Aug 17 04:10:05 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:10:05 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/console.log" append="off"/>
Aug 17 04:10:05 user nova-compute[72793]:     </serial>
Aug 17 04:10:05 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:10:05 user nova-compute[72793]:     <video>
Aug 17 04:10:05 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:10:05 user nova-compute[72793]:     </video>
Aug 17 04:10:05 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:10:05 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:10:05 user nova-compute[72793]:     </rng>
Aug 17 04:10:05 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:10:05 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:10:05 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:10:05 user nova-compute[72793]:     </memballoon>
Aug 17 04:10:05 user nova-compute[72793]:   </devices>
Aug 17 04:10:05 user nova-compute[72793]: </domain>
Aug 17 04:10:05 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d469ac16-923a-4b54-ab0d-f256ae4ed20b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance destroyed successfully.
Aug 17 04:10:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8592f68-0b8d-4e5e-9030-baa1769b63a2]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Flushing IO for device /dev/sdf {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3fb2fe-59c1-4116-95e1-fd0d0c46272b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:5c:37:bd, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[801588b7-6ce2-49f4-9914-a2a2afaf530f]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] SCSI volumes sdf have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updated VIF entry in instance network info cache for port 06b66834-5f15-4470-88bd-3bc5fda3c059. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.neutron [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9233810-57f1-4346-b24a-0243361d88ee]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0f2c6222-eae7-46a1-a36c-489e09740bdd req-1beca063-17de-4c1d-8346-051804bbe4f8 service nova] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaa7a25-08ce-4af1-8773-9bf3cfd0bc4d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]
Aug 17 04:10:05 user nova-compute[72793]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.
Aug 17 04:10:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d70d4a1-bf12-43ae-8269-816b2c0c2648]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] <== disconnect_volume: return (389ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:10:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Deleting instance files /opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7_del
Aug 17 04:10:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Deletion of /opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7_del complete
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Releasing lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance network_info: |[{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-changed-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Refreshing instance network info cache due to event network-changed-136a24c8-e601-4edb-8343-e60ad8e27bd5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] Acquiring lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] Acquired lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Refreshing network info cache for port 136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for 6c830030-be1e-4aa1-a583-7fb997d51893 due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245406.3398733, 6c830030-be1e-4aa1-a583-7fb997d51893 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:06 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Resumed (Lifecycle Event)
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f9c455ae-1d72-4a5e-ba19-a9173fe72cdd tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:06 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245406.3411725, 6c830030-be1e-4aa1-a583-7fb997d51893 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:06 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Started (Lifecycle Event)
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updated VIF entry in instance network info cache for port 136a24c8-e601-4edb-8343-e60ad8e27bd5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.network.neutron [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:06 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Deleted allocations for instance d4b8f681-6b81-49fe-8455-7564e2cafff7
Aug 17 04:10:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-47d5766e-d838-46e8-abdc-886085697394 req-b62421bf-2bfc-44fe-b996-dad993dac224 service nova] Releasing lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:06 user nova-compute[72793]: DEBUG nova.objects.instance [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'numa_topology' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing instance network info cache due to event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.volume.cinder [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Update attachment failed for attachment bf8b382f-ab5c-48c5-96c5-8e96139e70ed. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-eeda9723-9261-4510-b68c-a1bfe7cd675b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-eeda9723-9261-4510-b68c-a1bfe7cd675b)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Failed to attach 2f7c45ec-b150-44d7-aeed-0063561c86c5 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-eeda9723-9261-4510-b68c-a1bfe7cd675b)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Traceback (most recent call last):
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     ret_val = method(obj, context, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     self._do_attach(context, instance, volume, volume_api,
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     self._volume_attach(context, volume, connector, instance,
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     connection_info = volume_api.attachment_update(
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     res = method(self, ctx, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     with excutils.save_and_reraise_exception():
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     self.force_reraise()
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     raise self.value
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     return method.func(obj, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     resp = self._update('/attachments/%s' % id, body)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     return self.request(url, method, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed]     raise exceptions.from_response(resp, body)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-eeda9723-9261-4510-b68c-a1bfe7cd675b)
Aug 17 04:10:07 user nova-compute[72793]: ERROR nova.compute.manager [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] 
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:07 user nova-compute[72793]: WARNING nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state shelved_offloaded and task_state None.
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:07 user nova-compute[72793]: WARNING nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state active and task_state None.
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:07 user nova-compute[72793]: WARNING nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state active and task_state None.
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:07 user nova-compute[72793]: WARNING nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state active and task_state rescuing.
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:07 user nova-compute[72793]: WARNING nova.compute.manager [req-5d468d77-f79e-4a52-8413-b4f3305e3a0a req-e6e2a6cd-a0a1-432c-8a77-57ab627f48e2 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state active and task_state rescuing.
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.265s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server [None req-e9096236-9c05-463f-9df9-47da7a2ee72e tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-eeda9723-9261-4510-b68c-a1bfe7cd675b)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:2f7c45ec-b150-44d7-aeed-0063561c86c5/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:Failed to load the config.).). (HTTP 500) (Request-ID: req-eeda9723-9261-4510-b68c-a1bfe7cd675b)
Aug 17 04:10:07 user nova-compute[72793]: ERROR oslo_messaging.rpc.server 
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d27a7f43-54f5-411c-909a-048329e83ec9 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.814s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updated VIF entry in instance network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": null, "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape765bd5a-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9fa56251-4242-4a9e-9f72-4c605f683a6f req-5aeabbd0-d97a-4ed7-8cdc-a65dac1836f4 service nova] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:09 user nova-compute[72793]: WARNING nova.compute.manager [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state active and task_state rescuing.
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:09 user nova-compute[72793]: WARNING nova.compute.manager [req-e83f58be-8efe-4361-920c-adc3d10bde31 req-245f0e17-ae1b-4bdd-8915-b950aad964c9 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state active and task_state rescuing.
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for fc597951-d11b-4e35-8ee5-1f35c14c37eb due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245409.5125794, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Resumed (Lifecycle Event)
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cdbc35b3-67b1-4739-9878-7e6e71f0c1b5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245409.514264, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:09 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Started (Lifecycle Event)
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updating instance_info_cache with network_info: [{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:10:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:12 user nova-compute[72793]: INFO nova.compute.manager [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Terminating instance
Aug 17 04:10:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:10:12 user nova-compute[72793]: INFO nova.compute.claims [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Claim successful on node user
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.297s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d06d3ad-5b62-481d-b288-8814d5db3be4 req-783e5fce-e33a-419c-8bca-e8a568bb5b33 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-vif-unplugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d06d3ad-5b62-481d-b288-8814d5db3be4 req-783e5fce-e33a-419c-8bca-e8a568bb5b33 service nova] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d06d3ad-5b62-481d-b288-8814d5db3be4 req-783e5fce-e33a-419c-8bca-e8a568bb5b33 service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d06d3ad-5b62-481d-b288-8814d5db3be4 req-783e5fce-e33a-419c-8bca-e8a568bb5b33 service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d06d3ad-5b62-481d-b288-8814d5db3be4 req-783e5fce-e33a-419c-8bca-e8a568bb5b33 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] No waiting events found dispatching network-vif-unplugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d06d3ad-5b62-481d-b288-8814d5db3be4 req-783e5fce-e33a-419c-8bca-e8a568bb5b33 service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-vif-unplugged-cc891a9e-5324-4a9f-9d12-930773b32e25 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.305s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Instance destroyed successfully.
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.objects.instance [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lazy-loading 'resources' on Instance uuid 17cc3235-4e5d-41de-91ba-8cca63ba2585 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1116381965',display_name='tempest-TestServerVolumeAttachmentScenario-server-1116381965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1116381965',id=25,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXQwAsfVNmiCHHb7v6JsAiXnjzgaJM4Y1qqp7cn3moh9hZ9gxGOMJTDYWnsMXed0xnueca5Z9G9DNx+eFVNT+ZQKi+EBzv0BZKXtvJbPhcEd1BfAJQ/SgSSUjHNWTbRzg==',key_name='tempest-keypair-685706486',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:05:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1748744bd54e4bda8621e8bae5595178',ramdisk_id='',reservation_id='r-ia7ho10v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-450958633',owner_user_name='tempest-TestServerVolumeAttachmentScenario-450958633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70ffd50546e64adeb74687cd0e03dab4',uuid=17cc3235-4e5d-41de-91ba-8cca63ba2585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Converting VIF {"id": "cc891a9e-5324-4a9f-9d12-930773b32e25", "address": "fa:16:3e:00:57:30", "network": {"id": "43dfe5d7-af75-4648-8d8b-d248ba9e5d0c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1138758467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1748744bd54e4bda8621e8bae5595178", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc891a9e-53", "ovs_interfaceid": "cc891a9e-5324-4a9f-9d12-930773b32e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG os_vif [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc891a9e-53, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:13 user nova-compute[72793]: INFO os_vif [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:57:30,bridge_name='br-int',has_traffic_filtering=True,id=cc891a9e-5324-4a9f-9d12-930773b32e25,network=Network(43dfe5d7-af75-4648-8d8b-d248ba9e5d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc891a9e-53')
Aug 17 04:10:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Deleting instance files /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585_del
Aug 17 04:10:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Deletion of /opt/stack/data/nova/instances/17cc3235-4e5d-41de-91ba-8cca63ba2585_del complete
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:10:13 user nova-compute[72793]: INFO nova.compute.manager [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.013s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:10:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:10:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Creating image(s)
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG nova.policy [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21663e2118004c528a64a7fba2e29ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec39bbf61f45c6963f018159dcb33c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.241s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.220s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk 1073741824" returned: 0 in 0.070s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.255s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.network.neutron [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Successfully created port: b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:10:14 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Took 1.41 seconds to deallocate network for instance.
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Cannot resize image /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'migration_context' on Instance uuid 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Ensure instance console log exists: /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] Acquiring lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] No waiting events found dispatching network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:14 user nova-compute[72793]: WARNING nova.compute.manager [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received unexpected event network-vif-plugged-cc891a9e-5324-4a9f-9d12-930773b32e25 for instance with vm_state deleted and task_state None.
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-93368237-d879-41fc-9319-70971dde20ac req-b46f190b-f74a-41f6-b7c1-9d2cdb7f5adc service nova] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Received event network-vif-deleted-cc891a9e-5324-4a9f-9d12-930773b32e25 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:15 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:15 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:15 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7699MB free_disk=25.219993591308594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:15 user nova-compute[72793]: INFO nova.compute.manager [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Terminating instance
Aug 17 04:10:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.305s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.495s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:16 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Deleted allocations for instance 17cc3235-4e5d-41de-91ba-8cca63ba2585
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 0caea72b-8769-4feb-ac34-5904ba45308f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be7bc739-249c-40f9-97ec-676a68a0660d tempest-TestServerVolumeAttachmentScenario-450958633 tempest-TestServerVolumeAttachmentScenario-450958633-project-member] Lock "17cc3235-4e5d-41de-91ba-8cca63ba2585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.361s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:10:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Instance destroyed successfully.
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'resources' on Instance uuid 0caea72b-8769-4feb-ac34-5904ba45308f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1507473122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1507473122',id=19,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrYpNqboEd0ERFKC5NS2ZIfTQfDZHRIFefcipuw+YBUg4ZM66mkSJgdM3pq8bkcMf+QrOE0d8rVnKiHxFsp6JC+nCOfBD7Y7xqpQdS1+iE15vnQG3i002oyVkZi95XEwQ==',key_name='tempest-keypair-208159808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-ndrldmu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=0caea72b-8769-4feb-ac34-5904ba45308f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "address": "fa:16:3e:f1:87:19", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d7ebec7-8e", "ovs_interfaceid": "1d7ebec7-8e91-448f-83b0-340f8d4f68a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG os_vif [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d7ebec7-8e, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.770s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:10:16 user nova-compute[72793]: INFO os_vif [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:87:19,bridge_name='br-int',has_traffic_filtering=True,id=1d7ebec7-8e91-448f-83b0-340f8d4f68a7,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d7ebec7-8e')
Aug 17 04:10:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Deleting instance files /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f_del
Aug 17 04:10:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Deletion of /opt/stack/data/nova/instances/0caea72b-8769-4feb-ac34-5904ba45308f_del complete
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Successfully updated port: b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:10:17 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Creating image(s)
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Ensure instance console log exists: /opt/stack/data/nova/instances/758b73d6-9b4c-46cc-be56-a17f56709cf4/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Start _get_guest_xml network_info=[{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '758b73d6-9b4c-46cc-be56-a17f56709cf4', 'attached_at': '', 'detached_at': '', 'volume_id': '06eeb596-a6d1-4bd6-b628-8ef789462193', 'serial': '06eeb596-a6d1-4bd6-b628-8ef789462193'}, 'guest_format': None, 'attachment_id': '9c92777f-de57-4f26-a356-038b11d5423b', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-changed-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Refreshing instance network info cache due to event network-changed-b801eece-ac6d-4542-acfa-7cc59a20fd6b. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] Acquiring lock "refresh_cache-4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:10:17 user nova-compute[72793]: INFO nova.compute.manager [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:10:17 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:17 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245402.1090415, d4b8f681-6b81-49fe-8455-7564e2cafff7 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:17 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] VM Stopped (Lifecycle Event)
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:10:17 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:10:17 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:10:17 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0e3f377f-3e76-4b4e-b7f3-59905a48c295 None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2324c249-c9df-46c3-9f1d-95b3f53c59cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:10:17 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0a7fb6-b820-4134-aa40-1c5a5d0cb596]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193] added
Aug 17 04:10:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed1898-c704-421b-b3d9-811604f5a6c8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7612c97-5fec-4a21-8298-3c9b62ea2dba]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVGusNEl {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVGusNEl" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f794bc10-0fb8-43e0-8f80-c1e2b73cdf68]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVGusNEl'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9efb19d-e3cd-4adb-8155-89acbb9069ba]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab721d7f-3b1c-4a5b-9593-23d4a20e5202]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:17 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:17 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f9786-9a24-4a30-b5a0-247998967240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]
Aug 17 04:10:17 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.
Aug 17 04:10:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d270063-b962-4a6a-be76-9df15c353f87]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a3be3-2c7d-482e-9b04-3b0d3358f457]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:17 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:17 user nova-compute[72793]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:10:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:17 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:17 user nova-compute[72793]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:10:17 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Updating instance_info_cache with network_info: [{"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d7c2e-c5a6-4941-9594-2238469ad99f]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Instance network_info: |[{"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] Acquired lock "refresh_cache-4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.neutron [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Refreshing network info cache for port b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Start _get_guest_xml network_info=[{"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:10:17 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:17 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1794108197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1794108197',id=30,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-af9qutcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:10:14Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=4b3b5660-7dfb-41a3-a5da-fe7f7862a61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.objects.instance [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:10:17 user nova-compute[72793]:   <uuid>4b3b5660-7dfb-41a3-a5da-fe7f7862a61d</uuid>
Aug 17 04:10:17 user nova-compute[72793]:   <name>instance-0000001e</name>
Aug 17 04:10:17 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:10:17 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:10:17 user nova-compute[72793]:   <metadata>
Aug 17 04:10:17 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:10:17 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:10:17 user nova-compute[72793]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1794108197</nova:name>
Aug 17 04:10:17 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:10:17</nova:creationTime>
Aug 17 04:10:17 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:10:17 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:10:17 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:10:17 user nova-compute[72793]:       <nova:owner>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:user uuid="21663e2118004c528a64a7fba2e29ee3">tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member</nova:user>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:project uuid="a1ec39bbf61f45c6963f018159dcb33c">tempest-ServerBootFromVolumeStableRescueTest-1752371327</nova:project>
Aug 17 04:10:17 user nova-compute[72793]:       </nova:owner>
Aug 17 04:10:17 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:10:17 user nova-compute[72793]:       <nova:ports>
Aug 17 04:10:17 user nova-compute[72793]:         <nova:port uuid="b801eece-ac6d-4542-acfa-7cc59a20fd6b">
Aug 17 04:10:17 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 04:10:17 user nova-compute[72793]:         </nova:port>
Aug 17 04:10:17 user nova-compute[72793]:       </nova:ports>
Aug 17 04:10:17 user nova-compute[72793]:     </nova:instance>
Aug 17 04:10:17 user nova-compute[72793]:   </metadata>
Aug 17 04:10:17 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:10:17 user nova-compute[72793]:     <system>
Aug 17 04:10:17 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:10:17 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:10:17 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:10:17 user nova-compute[72793]:       <entry name="serial">4b3b5660-7dfb-41a3-a5da-fe7f7862a61d</entry>
Aug 17 04:10:17 user nova-compute[72793]:       <entry name="uuid">4b3b5660-7dfb-41a3-a5da-fe7f7862a61d</entry>
Aug 17 04:10:17 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:10:17 user nova-compute[72793]:     </system>
Aug 17 04:10:17 user nova-compute[72793]:   </sysinfo>
Aug 17 04:10:17 user nova-compute[72793]:   <os>
Aug 17 04:10:17 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:10:17 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:10:17 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:10:17 user nova-compute[72793]:   </os>
Aug 17 04:10:17 user nova-compute[72793]:   <features>
Aug 17 04:10:17 user nova-compute[72793]:     <acpi/>
Aug 17 04:10:17 user nova-compute[72793]:     <apic/>
Aug 17 04:10:17 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:10:17 user nova-compute[72793]:   </features>
Aug 17 04:10:17 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:10:17 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:10:17 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:10:17 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:10:17 user nova-compute[72793]:   </clock>
Aug 17 04:10:17 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:10:17 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:10:17 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:10:17 user nova-compute[72793]:   </cpu>
Aug 17 04:10:17 user nova-compute[72793]:   <devices>
Aug 17 04:10:17 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:10:17 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:10:17 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk"/>
Aug 17 04:10:17 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:10:17 user nova-compute[72793]:     </disk>
Aug 17 04:10:17 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:10:17 user nova-compute[72793]:       <mac address="fa:16:3e:f0:01:66"/>
Aug 17 04:10:17 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:10:17 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:10:17 user nova-compute[72793]:       <target dev="tapb801eece-ac"/>
Aug 17 04:10:17 user nova-compute[72793]:     </interface>
Aug 17 04:10:17 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:10:17 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/console.log" append="off"/>
Aug 17 04:10:17 user nova-compute[72793]:     </serial>
Aug 17 04:10:17 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:10:17 user nova-compute[72793]:     <video>
Aug 17 04:10:17 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:10:17 user nova-compute[72793]:     </video>
Aug 17 04:10:17 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:10:17 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:10:17 user nova-compute[72793]:     </rng>
Aug 17 04:10:17 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:10:17 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:10:17 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:10:17 user nova-compute[72793]:     </memballoon>
Aug 17 04:10:17 user nova-compute[72793]:   </devices>
Aug 17 04:10:17 user nova-compute[72793]: </domain>
Aug 17 04:10:17 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1794108197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1794108197',id=30,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-af9qutcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:10:14Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=4b3b5660-7dfb-41a3-a5da-fe7f7862a61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG os_vif [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb801eece-ac, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb801eece-ac, col_values=(('external_ids', {'iface-id': 'b801eece-ac6d-4542-acfa-7cc59a20fd6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:01:66', 'vm-uuid': '4b3b5660-7dfb-41a3-a5da-fe7f7862a61d'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:17 user nova-compute[72793]: INFO os_vif [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac')
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:10:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No VIF found with MAC fa:16:3e:f0:01:66, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.neutron [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Updated VIF entry in instance network info cache for port b801eece-ac6d-4542-acfa-7cc59a20fd6b. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.neutron [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Updating instance_info_cache with network_info: [{"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8aa14e73-9bbb-4849-9430-030c2c7eadad req-31bff180-98c3-4e89-9e40-45f78123c017 service nova] Releasing lock "refresh_cache-4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23239343561626135', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239343561626135', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1382367539',display_name='tempest-ServerActionsTestOtherA-server-1382367539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1382367539',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-0388eifl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=758b73d6-9b4c-46cc-be56-a17f56709cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_devices' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:10:18 user nova-compute[72793]:   <uuid>758b73d6-9b4c-46cc-be56-a17f56709cf4</uuid>
Aug 17 04:10:18 user nova-compute[72793]:   <name>instance-0000001d</name>
Aug 17 04:10:18 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:10:18 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:10:18 user nova-compute[72793]:   <metadata>
Aug 17 04:10:18 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:10:18 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:10:18 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherA-server-1382367539</nova:name>
Aug 17 04:10:18 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:10:17</nova:creationTime>
Aug 17 04:10:18 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:10:18 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:10:18 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:10:18 user nova-compute[72793]:       <nova:owner>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:user uuid="65891e5eae334ee38675df619856db02">tempest-ServerActionsTestOtherA-1498578162-project-member</nova:user>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:project uuid="8c6b688c6c95499ab90009d73f378a92">tempest-ServerActionsTestOtherA-1498578162</nova:project>
Aug 17 04:10:18 user nova-compute[72793]:       </nova:owner>
Aug 17 04:10:18 user nova-compute[72793]:       <nova:ports>
Aug 17 04:10:18 user nova-compute[72793]:         <nova:port uuid="136a24c8-e601-4edb-8343-e60ad8e27bd5">
Aug 17 04:10:18 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 04:10:18 user nova-compute[72793]:         </nova:port>
Aug 17 04:10:18 user nova-compute[72793]:       </nova:ports>
Aug 17 04:10:18 user nova-compute[72793]:     </nova:instance>
Aug 17 04:10:18 user nova-compute[72793]:   </metadata>
Aug 17 04:10:18 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:10:18 user nova-compute[72793]:     <system>
Aug 17 04:10:18 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:10:18 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:10:18 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:10:18 user nova-compute[72793]:       <entry name="serial">758b73d6-9b4c-46cc-be56-a17f56709cf4</entry>
Aug 17 04:10:18 user nova-compute[72793]:       <entry name="uuid">758b73d6-9b4c-46cc-be56-a17f56709cf4</entry>
Aug 17 04:10:18 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:10:18 user nova-compute[72793]:     </system>
Aug 17 04:10:18 user nova-compute[72793]:   </sysinfo>
Aug 17 04:10:18 user nova-compute[72793]:   <os>
Aug 17 04:10:18 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:10:18 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:10:18 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:10:18 user nova-compute[72793]:   </os>
Aug 17 04:10:18 user nova-compute[72793]:   <features>
Aug 17 04:10:18 user nova-compute[72793]:     <acpi/>
Aug 17 04:10:18 user nova-compute[72793]:     <apic/>
Aug 17 04:10:18 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:10:18 user nova-compute[72793]:   </features>
Aug 17 04:10:18 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:10:18 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:10:18 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:10:18 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:10:18 user nova-compute[72793]:   </clock>
Aug 17 04:10:18 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:10:18 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:10:18 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:10:18 user nova-compute[72793]:   </cpu>
Aug 17 04:10:18 user nova-compute[72793]:   <devices>
Aug 17 04:10:18 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:10:18 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:10:18 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:10:18 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:10:18 user nova-compute[72793]:       <serial>06eeb596-a6d1-4bd6-b628-8ef789462193</serial>
Aug 17 04:10:18 user nova-compute[72793]:     </disk>
Aug 17 04:10:18 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:10:18 user nova-compute[72793]:       <mac address="fa:16:3e:5b:97:0b"/>
Aug 17 04:10:18 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:10:18 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:10:18 user nova-compute[72793]:       <target dev="tap136a24c8-e6"/>
Aug 17 04:10:18 user nova-compute[72793]:     </interface>
Aug 17 04:10:18 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:10:18 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/758b73d6-9b4c-46cc-be56-a17f56709cf4/console.log" append="off"/>
Aug 17 04:10:18 user nova-compute[72793]:     </serial>
Aug 17 04:10:18 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:10:18 user nova-compute[72793]:     <video>
Aug 17 04:10:18 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:10:18 user nova-compute[72793]:     </video>
Aug 17 04:10:18 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:10:18 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:10:18 user nova-compute[72793]:     </rng>
Aug 17 04:10:18 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:10:18 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:10:18 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:10:18 user nova-compute[72793]:     </memballoon>
Aug 17 04:10:18 user nova-compute[72793]:   </devices>
Aug 17 04:10:18 user nova-compute[72793]: </domain>
Aug 17 04:10:18 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1382367539',display_name='tempest-ServerActionsTestOtherA-server-1382367539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1382367539',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-0388eifl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:10:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=758b73d6-9b4c-46cc-be56-a17f56709cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG os_vif [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap136a24c8-e6, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap136a24c8-e6, col_values=(('external_ids', {'iface-id': '136a24c8-e601-4edb-8343-e60ad8e27bd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:97:0b', 'vm-uuid': '758b73d6-9b4c-46cc-be56-a17f56709cf4'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:18 user nova-compute[72793]: INFO os_vif [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6')
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No VIF found with MAC fa:16:3e:5b:97:0b, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:10:18 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Took 1.77 seconds to deallocate network for instance.
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-unplugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-unplugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:19 user nova-compute[72793]: WARNING nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-unplugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state deleted and task_state None.
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] Acquiring lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] Lock "0caea72b-8769-4feb-ac34-5904ba45308f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] No waiting events found dispatching network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:19 user nova-compute[72793]: WARNING nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received unexpected event network-vif-plugged-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 for instance with vm_state deleted and task_state None.
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-322b294c-9692-46e8-9d1f-ea01903a32ec req-dbad202f-6b17-4999-a628-bc20fe790592 service nova] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Received event network-vif-deleted-1d7ebec7-8e91-448f-83b0-340f8d4f68a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:19 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Deleted allocations for instance 0caea72b-8769-4feb-ac34-5904ba45308f
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e1c9887-d20b-4b58-a34e-ce1559c92aea tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "0caea72b-8769-4feb-ac34-5904ba45308f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.797s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-224ea479-69e3-4353-9b46-8259b0ce1046 req-ec5d5486-e2fb-4bfa-8120-22286a1840f1 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-224ea479-69e3-4353-9b46-8259b0ce1046 req-ec5d5486-e2fb-4bfa-8120-22286a1840f1 service nova] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-224ea479-69e3-4353-9b46-8259b0ce1046 req-ec5d5486-e2fb-4bfa-8120-22286a1840f1 service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-224ea479-69e3-4353-9b46-8259b0ce1046 req-ec5d5486-e2fb-4bfa-8120-22286a1840f1 service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-224ea479-69e3-4353-9b46-8259b0ce1046 req-ec5d5486-e2fb-4bfa-8120-22286a1840f1 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] No waiting events found dispatching network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:19 user nova-compute[72793]: WARNING nova.compute.manager [req-224ea479-69e3-4353-9b46-8259b0ce1046 req-ec5d5486-e2fb-4bfa-8120-22286a1840f1 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received unexpected event network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b for instance with vm_state building and task_state spawning.
Aug 17 04:10:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-9190ac9e-0a4d-40be-919a-ff3dbce80a03 req-337060e7-3810-47f3-ae64-fa0dd34285fb service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9190ac9e-0a4d-40be-919a-ff3dbce80a03 req-337060e7-3810-47f3-ae64-fa0dd34285fb service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9190ac9e-0a4d-40be-919a-ff3dbce80a03 req-337060e7-3810-47f3-ae64-fa0dd34285fb service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9190ac9e-0a4d-40be-919a-ff3dbce80a03 req-337060e7-3810-47f3-ae64-fa0dd34285fb service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-9190ac9e-0a4d-40be-919a-ff3dbce80a03 req-337060e7-3810-47f3-ae64-fa0dd34285fb service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:21 user nova-compute[72793]: WARNING nova.compute.manager [req-9190ac9e-0a4d-40be-919a-ff3dbce80a03 req-337060e7-3810-47f3-ae64-fa0dd34285fb service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state building and task_state spawning.
Aug 17 04:10:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-4796f336-6b3b-4a2a-82a9-1147e829362f req-a804481f-5997-462c-addc-d7c63151d4e7 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4796f336-6b3b-4a2a-82a9-1147e829362f req-a804481f-5997-462c-addc-d7c63151d4e7 service nova] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4796f336-6b3b-4a2a-82a9-1147e829362f req-a804481f-5997-462c-addc-d7c63151d4e7 service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4796f336-6b3b-4a2a-82a9-1147e829362f req-a804481f-5997-462c-addc-d7c63151d4e7 service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-4796f336-6b3b-4a2a-82a9-1147e829362f req-a804481f-5997-462c-addc-d7c63151d4e7 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] No waiting events found dispatching network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:21 user nova-compute[72793]: WARNING nova.compute.manager [req-4796f336-6b3b-4a2a-82a9-1147e829362f req-a804481f-5997-462c-addc-d7c63151d4e7 service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received unexpected event network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b for instance with vm_state building and task_state spawning.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245423.0053844, 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] VM Resumed (Lifecycle Event)
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Instance spawned successfully.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245423.0185277, 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] VM Started (Lifecycle Event)
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Took 9.37 seconds to spawn the instance on the hypervisor.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245423.1402335, 758b73d6-9b4c-46cc-be56-a17f56709cf4 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] VM Resumed (Lifecycle Event)
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-87adbb33-7e34-4851-84f5-bcd15ef5641c req-da17f824-d8c9-47df-895a-4570d46537d3 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-87adbb33-7e34-4851-84f5-bcd15ef5641c req-da17f824-d8c9-47df-895a-4570d46537d3 service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-87adbb33-7e34-4851-84f5-bcd15ef5641c req-da17f824-d8c9-47df-895a-4570d46537d3 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-87adbb33-7e34-4851-84f5-bcd15ef5641c req-da17f824-d8c9-47df-895a-4570d46537d3 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-87adbb33-7e34-4851-84f5-bcd15ef5641c req-da17f824-d8c9-47df-895a-4570d46537d3 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:10:23 user nova-compute[72793]: WARNING nova.compute.manager [req-87adbb33-7e34-4851-84f5-bcd15ef5641c req-da17f824-d8c9-47df-895a-4570d46537d3 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state building and task_state spawning.
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance spawned successfully.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245423.140509, 758b73d6-9b4c-46cc-be56-a17f56709cf4 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] VM Started (Lifecycle Event)
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Took 10.97 seconds to build instance.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-af2e5071-244c-4507-8da1-17ecc3e6bff7 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.146s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:23 user nova-compute[72793]: INFO nova.compute.manager [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Took 21.98 seconds to build instance.
Aug 17 04:10:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-00e29946-97af-4a2c-84e6-0a4ad363b02c tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.095s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:28 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245413.1064057, 17cc3235-4e5d-41de-91ba-8cca63ba2585 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:28 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] VM Stopped (Lifecycle Event)
Aug 17 04:10:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-160add71-4086-40d6-af4b-bce4c8fe1d92 None None] [instance: 17cc3235-4e5d-41de-91ba-8cca63ba2585] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:31 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245416.8854554, 0caea72b-8769-4feb-ac34-5904ba45308f => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:10:31 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] VM Stopped (Lifecycle Event)
Aug 17 04:10:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7dbd35f3-4ffc-4a14-ac31-6a54ed7475b9 None None] [instance: 0caea72b-8769-4feb-ac34-5904ba45308f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:10:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:10:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:10:34 user nova-compute[72793]: INFO nova.compute.manager [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Detaching volume 28f92a50-761e-4606-88d8-e13897b1aebf
Aug 17 04:10:34 user nova-compute[72793]: INFO nova.virt.block_device [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Attempting to driver detach volume 28f92a50-761e-4606-88d8-e13897b1aebf from mountpoint /dev/vdb
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Attempting to detach device vdb from instance 6c830030-be1e-4aa1-a583-7fb997d51893 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:10:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:10:34 user nova-compute[72793]:   <source dev="/dev/sdd"/>
Aug 17 04:10:34 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:10:34 user nova-compute[72793]:   <serial>28f92a50-761e-4606-88d8-e13897b1aebf</serial>
Aug 17 04:10:34 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:10:34 user nova-compute[72793]: </disk>
Aug 17 04:10:34 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:10:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Successfully detached device vdb from instance 6c830030-be1e-4aa1-a583-7fb997d51893 from the persistent domain config.
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c830030-be1e-4aa1-a583-7fb997d51893 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:10:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:10:34 user nova-compute[72793]:   <source dev="/dev/sdd"/>
Aug 17 04:10:34 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:10:34 user nova-compute[72793]:   <serial>28f92a50-761e-4606-88d8-e13897b1aebf</serial>
Aug 17 04:10:34 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:10:34 user nova-compute[72793]: </disk>
Aug 17 04:10:34 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245434.5300002, 6c830030-be1e-4aa1-a583-7fb997d51893 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:10:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Successfully detached device vdb from instance 6c830030-be1e-4aa1-a583-7fb997d51893 from the live domain config.
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eRPqYsIk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:10:34 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e9ec13-2ca6-4c7a-adc1-c1cb286b8366]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4094ed82-a619-4024-9bae-47750f06c21f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:34 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:34 user nova-compute[72793]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:10:34 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:10:34 user nova-compute[72793]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf (non-flash)
Aug 17 04:10:34 user nova-compute[72793]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:10:34 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02ba680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf'): ({'sdd'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Removing single pathed devices sdd {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be2c966-d84a-432c-ac0b-d45e4bc50ad6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a8811-37ca-48ae-9050-7848731ba00b]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Flushing IO for device /dev/sdd {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f4eb8-457d-47fa-93c1-6c4d6967bfd6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[41da4ec2-d8df-4a93-ae5d-26b81f8a4583]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9cc55d-8985-4272-be22-4eb3b97a15cd]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da90e58-a182-40c6-862c-8bb31b35d808]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260]
Aug 17 04:10:34 user nova-compute[72793]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf, portal: 172.16.0.220,3260] successful.
Aug 17 04:10:34 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f92a50-761e-4606-88d8-e13897b1aebf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f0f37f-87f8-449b-b3a2-07d61db07dba]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] <== disconnect_volume: return (314ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:10:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:10:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:35 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'flavor' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:10:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1f949c0d-0d3f-4ccb-b6d7-6b0449eb1910 tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.814s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:10:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:10:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:09 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:11:10 user nova-compute[72793]: INFO nova.compute.claims [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Claim successful on node user
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:11:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:11:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:11:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.policy [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1420f8967734176ac04ac8b1e2646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f916dfd267de46389faa83f4947db86f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:11:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Creating image(s)
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.194s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk 1073741824" returned: 0 in 0.057s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [{"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-6c830030-be1e-4aa1-a583-7fb997d51893" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Successfully created port: d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Cannot resize image /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'migration_context' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Ensure instance console log exists: /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Successfully updated port: d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing instance network info cache due to event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:11:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance network_info: |[{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Start _get_guest_xml network_info=[{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:11:13 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:11:13 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-362401097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-362401097',id=31,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzVcsyfpu/dNQgtTdJSiJg8n9aFu3HLg5KwUrSwfsJ+0by6pPeXq6kZOQYpp4+JC/c27Uwf6kkW6EMeQaf8xNjvNxpyQrPSQDS8jkeGXIVQTfh/yhdNm0M/dm/T+S3Wjg==',key_name='tempest-keypair-1719939993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-k8m4wj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=8ffa2387-a317-4b02-90be-797d8de5c6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:11:13 user nova-compute[72793]:   <uuid>8ffa2387-a317-4b02-90be-797d8de5c6b9</uuid>
Aug 17 04:11:13 user nova-compute[72793]:   <name>instance-0000001f</name>
Aug 17 04:11:13 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:11:13 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:11:13 user nova-compute[72793]:   <metadata>
Aug 17 04:11:13 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:11:13 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:11:13 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-362401097</nova:name>
Aug 17 04:11:13 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:11:13</nova:creationTime>
Aug 17 04:11:13 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:11:13 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:11:13 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:11:13 user nova-compute[72793]:       <nova:owner>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:user uuid="e1420f8967734176ac04ac8b1e2646ea">tempest-AttachVolumeShelveTestJSON-266550928-project-member</nova:user>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:project uuid="f916dfd267de46389faa83f4947db86f">tempest-AttachVolumeShelveTestJSON-266550928</nova:project>
Aug 17 04:11:13 user nova-compute[72793]:       </nova:owner>
Aug 17 04:11:13 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:11:13 user nova-compute[72793]:       <nova:ports>
Aug 17 04:11:13 user nova-compute[72793]:         <nova:port uuid="d9fdf7ae-ef51-4807-b307-ab01e770070b">
Aug 17 04:11:13 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:11:13 user nova-compute[72793]:         </nova:port>
Aug 17 04:11:13 user nova-compute[72793]:       </nova:ports>
Aug 17 04:11:13 user nova-compute[72793]:     </nova:instance>
Aug 17 04:11:13 user nova-compute[72793]:   </metadata>
Aug 17 04:11:13 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:11:13 user nova-compute[72793]:     <system>
Aug 17 04:11:13 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:11:13 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:11:13 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:11:13 user nova-compute[72793]:       <entry name="serial">8ffa2387-a317-4b02-90be-797d8de5c6b9</entry>
Aug 17 04:11:13 user nova-compute[72793]:       <entry name="uuid">8ffa2387-a317-4b02-90be-797d8de5c6b9</entry>
Aug 17 04:11:13 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:11:13 user nova-compute[72793]:     </system>
Aug 17 04:11:13 user nova-compute[72793]:   </sysinfo>
Aug 17 04:11:13 user nova-compute[72793]:   <os>
Aug 17 04:11:13 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:11:13 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:11:13 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:11:13 user nova-compute[72793]:   </os>
Aug 17 04:11:13 user nova-compute[72793]:   <features>
Aug 17 04:11:13 user nova-compute[72793]:     <acpi/>
Aug 17 04:11:13 user nova-compute[72793]:     <apic/>
Aug 17 04:11:13 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:11:13 user nova-compute[72793]:   </features>
Aug 17 04:11:13 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:11:13 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:11:13 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:11:13 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:11:13 user nova-compute[72793]:   </clock>
Aug 17 04:11:13 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:11:13 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:11:13 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:11:13 user nova-compute[72793]:   </cpu>
Aug 17 04:11:13 user nova-compute[72793]:   <devices>
Aug 17 04:11:13 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:11:13 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:11:13 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk"/>
Aug 17 04:11:13 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:11:13 user nova-compute[72793]:     </disk>
Aug 17 04:11:13 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:11:13 user nova-compute[72793]:       <mac address="fa:16:3e:d6:04:ee"/>
Aug 17 04:11:13 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:11:13 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:11:13 user nova-compute[72793]:       <target dev="tapd9fdf7ae-ef"/>
Aug 17 04:11:13 user nova-compute[72793]:     </interface>
Aug 17 04:11:13 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:11:13 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/console.log" append="off"/>
Aug 17 04:11:13 user nova-compute[72793]:     </serial>
Aug 17 04:11:13 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:11:13 user nova-compute[72793]:     <video>
Aug 17 04:11:13 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:11:13 user nova-compute[72793]:     </video>
Aug 17 04:11:13 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:11:13 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:11:13 user nova-compute[72793]:     </rng>
Aug 17 04:11:13 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:11:13 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:11:13 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:11:13 user nova-compute[72793]:     </memballoon>
Aug 17 04:11:13 user nova-compute[72793]:   </devices>
Aug 17 04:11:13 user nova-compute[72793]: </domain>
Aug 17 04:11:13 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-362401097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-362401097',id=31,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzVcsyfpu/dNQgtTdJSiJg8n9aFu3HLg5KwUrSwfsJ+0by6pPeXq6kZOQYpp4+JC/c27Uwf6kkW6EMeQaf8xNjvNxpyQrPSQDS8jkeGXIVQTfh/yhdNm0M/dm/T+S3Wjg==',key_name='tempest-keypair-1719939993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-k8m4wj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:11:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=8ffa2387-a317-4b02-90be-797d8de5c6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG os_vif [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9fdf7ae-ef, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9fdf7ae-ef, col_values=(('external_ids', {'iface-id': 'd9fdf7ae-ef51-4807-b307-ab01e770070b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:04:ee', 'vm-uuid': '8ffa2387-a317-4b02-90be-797d8de5c6b9'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:13 user nova-compute[72793]: INFO os_vif [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef')
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No VIF found with MAC fa:16:3e:d6:04:ee, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updated VIF entry in instance network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG nova.network.neutron [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-81333365-ed38-43cd-a366-8d4d79a6708c req-802df5e1-6ae5-4683-a26a-c0b16165a67e service nova] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-3a5c4118-85a8-4ed0-9648-74f15cfbf8fd req-2a1af449-5a2f-461a-acf1-1730d4dfee85 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3a5c4118-85a8-4ed0-9648-74f15cfbf8fd req-2a1af449-5a2f-461a-acf1-1730d4dfee85 service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3a5c4118-85a8-4ed0-9648-74f15cfbf8fd req-2a1af449-5a2f-461a-acf1-1730d4dfee85 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3a5c4118-85a8-4ed0-9648-74f15cfbf8fd req-2a1af449-5a2f-461a-acf1-1730d4dfee85 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-3a5c4118-85a8-4ed0-9648-74f15cfbf8fd req-2a1af449-5a2f-461a-acf1-1730d4dfee85 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:15 user nova-compute[72793]: WARNING nova.compute.manager [req-3a5c4118-85a8-4ed0-9648-74f15cfbf8fd req-2a1af449-5a2f-461a-acf1-1730d4dfee85 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state building and task_state spawning.
Aug 17 04:11:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245477.9420722, 8ffa2387-a317-4b02-90be-797d8de5c6b9 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] VM Resumed (Lifecycle Event)
Aug 17 04:11:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-1cf693ee-0e25-4746-a7d7-ead6ab877e43 req-27b6be60-0c27-4ba2-837d-bf867995e2d9 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1cf693ee-0e25-4746-a7d7-ead6ab877e43 req-27b6be60-0c27-4ba2-837d-bf867995e2d9 service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1cf693ee-0e25-4746-a7d7-ead6ab877e43 req-27b6be60-0c27-4ba2-837d-bf867995e2d9 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1cf693ee-0e25-4746-a7d7-ead6ab877e43 req-27b6be60-0c27-4ba2-837d-bf867995e2d9 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-1cf693ee-0e25-4746-a7d7-ead6ab877e43 req-27b6be60-0c27-4ba2-837d-bf867995e2d9 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:18 user nova-compute[72793]: WARNING nova.compute.manager [req-1cf693ee-0e25-4746-a7d7-ead6ab877e43 req-27b6be60-0c27-4ba2-837d-bf867995e2d9 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state building and task_state spawning.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance spawned successfully.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:11:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:11:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=25.24213409423828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245477.943993, 8ffa2387-a317-4b02-90be-797d8de5c6b9 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] VM Started (Lifecycle Event)
Aug 17 04:11:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Took 7.45 seconds to spawn the instance on the hypervisor.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6c830030-be1e-4aa1-a583-7fb997d51893 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ffa2387-a317-4b02-90be-797d8de5c6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:11:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:11:18 user nova-compute[72793]: INFO nova.compute.manager [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Took 8.34 seconds to build instance.
Aug 17 04:11:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6a2ef1ba-9e58-4695-95de-4ddbdf15966a tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.441s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:11:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:11:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:11:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:11:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:24 user nova-compute[72793]: INFO nova.compute.manager [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Terminating instance
Aug 17 04:11:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Instance destroyed successfully.
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lazy-loading 'resources' on Instance uuid 6c830030-be1e-4aa1-a583-7fb997d51893 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267099843',display_name='tempest-ServerStableDeviceRescueTest-server-1267099843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267099843',id=20,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSM5dElm1GppRv3T2Lvsupvvf5j/KDOnFCs4lE0qN6Bcc0viR6WUM7+FkycjToeoGztWOGAssgzvU4SZTkv61Gg3X14wBlMQdd5/PkUUTFiFp/VW/mKukrQ1hL5DwM8dw==',key_name='tempest-keypair-56794815',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:08:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbcbbda6abba4007a6055ee0f9c01c33',ramdisk_id='',reservation_id='r-i6gy50hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-621052297',owner_user_name='tempest-ServerStableDeviceRescueTest-621052297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7fa68c3f41e4c07b1026e56ab3b4852',uuid=6c830030-be1e-4aa1-a583-7fb997d51893,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converting VIF {"id": "06b66834-5f15-4470-88bd-3bc5fda3c059", "address": "fa:16:3e:8d:a0:36", "network": {"id": "f34e20e5-9333-49c1-a704-ce0a10c63ac5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-213916548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbcbbda6abba4007a6055ee0f9c01c33", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b66834-5f", "ovs_interfaceid": "06b66834-5f15-4470-88bd-3bc5fda3c059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG os_vif [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d60f232-330d-4191-baa5-7587ed5c061c req-a8c08c54-bfee-4f2a-97b1-5f50d252f28e service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d60f232-330d-4191-baa5-7587ed5c061c req-a8c08c54-bfee-4f2a-97b1-5f50d252f28e service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d60f232-330d-4191-baa5-7587ed5c061c req-a8c08c54-bfee-4f2a-97b1-5f50d252f28e service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d60f232-330d-4191-baa5-7587ed5c061c req-a8c08c54-bfee-4f2a-97b1-5f50d252f28e service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d60f232-330d-4191-baa5-7587ed5c061c req-a8c08c54-bfee-4f2a-97b1-5f50d252f28e service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d60f232-330d-4191-baa5-7587ed5c061c req-a8c08c54-bfee-4f2a-97b1-5f50d252f28e service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-unplugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06b66834-5f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:25 user nova-compute[72793]: INFO os_vif [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:a0:36,bridge_name='br-int',has_traffic_filtering=True,id=06b66834-5f15-4470-88bd-3bc5fda3c059,network=Network(f34e20e5-9333-49c1-a704-ce0a10c63ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b66834-5f')
Aug 17 04:11:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Deleting instance files /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893_del
Aug 17 04:11:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Deletion of /opt/stack/data/nova/instances/6c830030-be1e-4aa1-a583-7fb997d51893_del complete
Aug 17 04:11:25 user nova-compute[72793]: INFO nova.compute.manager [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 04:11:25 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:11:25 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:11:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:27 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Took 1.57 seconds to deallocate network for instance.
Aug 17 04:11:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] Acquiring lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] Lock "6c830030-be1e-4aa1-a583-7fb997d51893-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] No waiting events found dispatching network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:27 user nova-compute[72793]: WARNING nova.compute.manager [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received unexpected event network-vif-plugged-06b66834-5f15-4470-88bd-3bc5fda3c059 for instance with vm_state deleted and task_state None.
Aug 17 04:11:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-582eb200-3bf4-4077-a71f-8626493b27fc req-f6b8b89d-dd5f-4310-af86-c98366d146e4 service nova] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Received event network-vif-deleted-06b66834-5f15-4470-88bd-3bc5fda3c059 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:11:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:27 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Deleted allocations for instance 6c830030-be1e-4aa1-a583-7fb997d51893
Aug 17 04:11:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-358d0a9a-6562-43db-92b0-369b8508c7ab tempest-ServerStableDeviceRescueTest-621052297 tempest-ServerStableDeviceRescueTest-621052297-project-member] Lock "6c830030-be1e-4aa1-a583-7fb997d51893" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.226s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:40 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245485.6783285, 6c830030-be1e-4aa1-a583-7fb997d51893 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:11:40 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] VM Stopped (Lifecycle Event)
Aug 17 04:11:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3f24eee2-16fb-4928-a650-4187182dd0cd None None] [instance: 6c830030-be1e-4aa1-a583-7fb997d51893] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:52 user nova-compute[72793]: INFO nova.compute.manager [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Unshelving
Aug 17 04:11:52 user nova-compute[72793]: INFO nova.virt.block_device [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Booting with volume b3917248-1333-4826-b941-b7e0ab0c5ced at /dev/vda
Aug 17 04:11:52 user nova-compute[72793]: DEBUG os_brick.utils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f858797-b85f-4560-b4e6-f1b8f948d359]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c2bb6-e826-49ce-9bd1-b10405e92a11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c94cc-104a-4974-8af2-52ed9ab90261]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[62517ab3-aa31-4198-9dfe-23c46bc00c89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:11:52 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0479e6ab-f99e-449b-9885-0e1aa828039c]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG os_brick.utils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating existing volume attachment record: 4a4193a8-6049-4f98-ae83-987f6ed58eef {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-changed-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Refreshing instance network info cache due to event network-changed-85751269-3e2b-4a54-a738-f2532f5d07b9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG nova.network.neutron [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Refreshing network info cache for port 85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:11:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated VIF entry in instance network info cache for port 85751269-3e2b-4a54-a738-f2532f5d07b9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:11:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8cff60b7-c7f8-4692-91f8-ebec94782518 req-77e66714-b58e-4370-be78-6f8472673b47 service nova] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:54 user nova-compute[72793]: INFO nova.compute.manager [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Unrescuing
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Stashing vm_state: active {{(pid=72793) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-changed-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Refreshing instance network info cache due to event network-changed-136a24c8-e601-4edb-8343-e60ad8e27bd5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] Acquiring lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] Acquired lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Refreshing network info cache for port 136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_requests' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:11:54 user nova-compute[72793]: INFO nova.compute.claims [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Claim successful on node user
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'resources' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'pci_devices' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:54 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating resource usage from migration 3ad4a698-6952-43aa-8352-d532881632f7
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'flavor' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-fc15e4d3-0a4b-4723-b16c-cfa24f2a9c84 req-ea17033a-b1ed-40be-bea9-d57151989987 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fc15e4d3-0a4b-4723-b16c-cfa24f2a9c84 req-ea17033a-b1ed-40be-bea9-d57151989987 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fc15e4d3-0a4b-4723-b16c-cfa24f2a9c84 req-ea17033a-b1ed-40be-bea9-d57151989987 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fc15e4d3-0a4b-4723-b16c-cfa24f2a9c84 req-ea17033a-b1ed-40be-bea9-d57151989987 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-fc15e4d3-0a4b-4723-b16c-cfa24f2a9c84 req-ea17033a-b1ed-40be-bea9-d57151989987 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:55 user nova-compute[72793]: WARNING nova.compute.manager [req-fc15e4d3-0a4b-4723-b16c-cfa24f2a9c84 req-ea17033a-b1ed-40be-bea9-d57151989987 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.658s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:55 user nova-compute[72793]: INFO nova.compute.manager [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Migrating
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updated VIF entry in instance network info cache for port 136a24c8-e601-4edb-8343-e60ad8e27bd5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.network.neutron [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bc91f6cb-75c5-4cd0-89a6-5e65e3032021 req-bcc7fe28-d52b-4a64-a72c-6ee7092ccd08 service nova] Releasing lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquired lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:11:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:55 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance destroyed successfully.
Aug 17 04:11:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Releasing lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Starting migrate_disk_and_power_off {{(pid=72793) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-a83683ad-ff60-42c3-a336-81b34239fef5 req-5dcc98b3-28df-4100-bc76-d33a073536f9 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-unplugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a83683ad-ff60-42c3-a336-81b34239fef5 req-5dcc98b3-28df-4100-bc76-d33a073536f9 service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a83683ad-ff60-42c3-a336-81b34239fef5 req-5dcc98b3-28df-4100-bc76-d33a073536f9 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a83683ad-ff60-42c3-a336-81b34239fef5 req-5dcc98b3-28df-4100-bc76-d33a073536f9 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-a83683ad-ff60-42c3-a336-81b34239fef5 req-5dcc98b3-28df-4100-bc76-d33a073536f9 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-unplugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:56 user nova-compute[72793]: WARNING nova.compute.manager [req-a83683ad-ff60-42c3-a336-81b34239fef5 req-5dcc98b3-28df-4100-bc76-d33a073536f9 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-unplugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state active and task_state resize_migrating.
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-57f969f1-c98b-474e-a81f-acda85eb64c6 req-37460c22-7138-4b24-8362-91a321098473 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-57f969f1-c98b-474e-a81f-acda85eb64c6 req-37460c22-7138-4b24-8362-91a321098473 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-57f969f1-c98b-474e-a81f-acda85eb64c6 req-37460c22-7138-4b24-8362-91a321098473 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-57f969f1-c98b-474e-a81f-acda85eb64c6 req-37460c22-7138-4b24-8362-91a321098473 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-57f969f1-c98b-474e-a81f-acda85eb64c6 req-37460c22-7138-4b24-8362-91a321098473 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:57 user nova-compute[72793]: WARNING nova.compute.manager [req-57f969f1-c98b-474e-a81f-acda85eb64c6 req-37460c22-7138-4b24-8362-91a321098473 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:11:57 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance destroyed successfully.
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1382367539',display_name='tempest-ServerActionsTestOtherA-server-1382367539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1382367539',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-0388eifl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=758b73d6-9b4c-46cc-be56-a17f56709cf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap136a24c8-e6, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: INFO os_vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6')
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:11:57 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8129abb-aad7-4a6d-9824-c8ce7e62bdde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2588bd-7938-4b22-badd-99fdb60e0c98]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:11:57 user nova-compute[72793]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:11:57 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:11:57 user nova-compute[72793]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:11:57 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02dc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f2282e-e742-456f-b6d7-69fb5e4ad7ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[552f229b-26f9-4c7a-b9a6-716374c0ac24]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6795ce2b-39b5-4abf-bb4a-567898c7c467]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[654e2894-320f-41c5-9b95-1dcbc27469cf]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0dc03-dc8a-44d4-85dc-482e8fe83e00]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d56a693-4e4e-4487-88bd-adbad2dfa5a6]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]
Aug 17 04:11:57 user nova-compute[72793]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.
Aug 17 04:11:57 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c23820-4430-4948-b085-be3fff2b092f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== disconnect_volume: return (311ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:11:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Port 136a24c8-e601-4edb-8343-e60ad8e27bd5 binding to destination host user is already ACTIVE {{(pid=72793) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquired lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:59 user nova-compute[72793]: WARNING nova.compute.manager [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:59 user nova-compute[72793]: WARNING nova.compute.manager [req-6c30c2dd-5417-45f6-ab8d-7e41851a6489 req-f2b8be54-014d-4a59-acb5-e18f9f7de34f service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-59c3d876-374e-4f91-a6b3-5271c86b653b req-9a704416-09f3-4a1f-8953-2d18665d490f service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59c3d876-374e-4f91-a6b3-5271c86b653b req-9a704416-09f3-4a1f-8953-2d18665d490f service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59c3d876-374e-4f91-a6b3-5271c86b653b req-9a704416-09f3-4a1f-8953-2d18665d490f service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-59c3d876-374e-4f91-a6b3-5271c86b653b req-9a704416-09f3-4a1f-8953-2d18665d490f service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-59c3d876-374e-4f91-a6b3-5271c86b653b req-9a704416-09f3-4a1f-8953-2d18665d490f service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:11:59 user nova-compute[72793]: WARNING nova.compute.manager [req-59c3d876-374e-4f91-a6b3-5271c86b653b req-9a704416-09f3-4a1f-8953-2d18665d490f service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state active and task_state resize_migrated.
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for fc597951-d11b-4e35-8ee5-1f35c14c37eb due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245519.8272028, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:11:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Resumed (Lifecycle Event)
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-91c067df-2dbc-4eba-9cd6-b2914225b6eb tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:11:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245519.8297324, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:11:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Started (Lifecycle Event)
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:11:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Releasing lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG os_brick.utils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc328d-37cd-4ff0-a025-961b2a3dc559]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0bed58-06ea-4b2b-8522-a929403065e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f14451-25bd-4f4c-abea-8dc85e2d9db9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[790f3712-321c-49b5-9938-91c44aaafdc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:12:00 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:12:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[456d17b2-eda7-4dcd-a1e1-7cd5b3051111]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:12:00 user nova-compute[72793]: DEBUG os_brick.utils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:12:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:03 user nova-compute[72793]: INFO nova.compute.manager [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] instance snapshotting
Aug 17 04:12:03 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Beginning live snapshot process
Aug 17 04:12:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.247s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf2iz0dan/cee1f3086f1447d6a4095a7b39bc31eb.delta 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf2iz0dan/cee1f3086f1447d6a4095a7b39bc31eb.delta 1073741824" returned: 0 in 0.063s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 04:12:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:12:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'pci_requests' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'numa_topology' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:12:05 user nova-compute[72793]: INFO nova.compute.claims [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Claim successful on node user
Aug 17 04:12:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] COPY block job progress, current cursor: 25100288 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:12:06 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:12:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:12:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:06 user nova-compute[72793]: INFO nova.network.neutron [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating port e765bd5a-bdb6-4f7f-809b-fea1940e60b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 04:12:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:12:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 04:12:06 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:12:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf2iz0dan/cee1f3086f1447d6a4095a7b39bc31eb.delta /opt/stack/data/nova/instances/snapshots/tmpf2iz0dan/cee1f3086f1447d6a4095a7b39bc31eb {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf2iz0dan/cee1f3086f1447d6a4095a7b39bc31eb.delta /opt/stack/data/nova/instances/snapshots/tmpf2iz0dan/cee1f3086f1447d6a4095a7b39bc31eb" returned: 0 in 0.754s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Snapshot extracted, beginning image upload
Aug 17 04:12:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing instance network info cache due to event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:12:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:12:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Creating image(s)
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Ensure instance console log exists: /opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Start _get_guest_xml network_info=[{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4b8f681-6b81-49fe-8455-7564e2cafff7', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3917248-1333-4826-b941-b7e0ab0c5ced', 'serial': 'b3917248-1333-4826-b941-b7e0ab0c5ced'}, 'guest_format': None, 'attachment_id': '4a4193a8-6049-4f98-ae83-987f6ed58eef', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.network.neutron [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:12:08 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:08 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:12:08 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:12:08 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:12:08 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f42f26-3f46-4b17-9bd2-5342ea8b1077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:12:08 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cad501-5fdf-4fd2-bb86-8b36f14fbe7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced] added
Aug 17 04:12:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e02627-1b72-482b-87bb-1853eadf2e70]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[10645975-4802-46dd-9266-5e855dd0aece]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnHkowIa {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JnHkowIa" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[692eb317-9d46-4d47-9a17-e049895fb64a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JnHkowIa'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc99d68-2913-47a7-a6f1-e5a305bff683]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec5ed4-18dd-4280-ab9e-a2f656c4a738]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc53fc3-a087-4bb2-b093-dc2963f6aefb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]
Aug 17 04:12:08 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.
Aug 17 04:12:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[af52ac10-43e3-4426-81e7-d686f7e8cb78]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6880247d-678a-4f10-b854-d78bab78cc07]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:08 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:12:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:08 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:12:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca4d33-db19-43b8-a795-f0c36d7ef4b1]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:12:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updated VIF entry in instance network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-51786a08-4d56-40e3-a0a1-b80000225c9c req-2ef7e814-0683-4dce-b7f2-1f5dc6e1ace4 service nova] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26138663930326233', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138663930326233', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1324529661',display_name='tempest-TestShelveInstance-server-1324529661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1324529661',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-567723049',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='29f31f57bb7f4b90b0f9d018a662c6e1',ramdisk_id='',reservation_id='r-jb4ngety',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-278994045',owner_user_name='tempest-TestShelveInstance-278994045-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:11:53Z,user_data=None,user_id='ddc21d6c97ef4b4a982b4011e9ebd13b',uuid=d4b8f681-6b81-49fe-8455-7564e2cafff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converting VIF {"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'pci_devices' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:12:09 user nova-compute[72793]:   <uuid>d4b8f681-6b81-49fe-8455-7564e2cafff7</uuid>
Aug 17 04:12:09 user nova-compute[72793]:   <name>instance-0000001c</name>
Aug 17 04:12:09 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:12:09 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:12:09 user nova-compute[72793]:   <metadata>
Aug 17 04:12:09 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:12:09 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:12:09 user nova-compute[72793]:       <nova:name>tempest-TestShelveInstance-server-1324529661</nova:name>
Aug 17 04:12:09 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:12:08</nova:creationTime>
Aug 17 04:12:09 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:12:09 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:12:09 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:12:09 user nova-compute[72793]:       <nova:owner>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:user uuid="ddc21d6c97ef4b4a982b4011e9ebd13b">tempest-TestShelveInstance-278994045-project-member</nova:user>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:project uuid="29f31f57bb7f4b90b0f9d018a662c6e1">tempest-TestShelveInstance-278994045</nova:project>
Aug 17 04:12:09 user nova-compute[72793]:       </nova:owner>
Aug 17 04:12:09 user nova-compute[72793]:       <nova:ports>
Aug 17 04:12:09 user nova-compute[72793]:         <nova:port uuid="e765bd5a-bdb6-4f7f-809b-fea1940e60b2">
Aug 17 04:12:09 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:12:09 user nova-compute[72793]:         </nova:port>
Aug 17 04:12:09 user nova-compute[72793]:       </nova:ports>
Aug 17 04:12:09 user nova-compute[72793]:     </nova:instance>
Aug 17 04:12:09 user nova-compute[72793]:   </metadata>
Aug 17 04:12:09 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:12:09 user nova-compute[72793]:     <system>
Aug 17 04:12:09 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:12:09 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:12:09 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:12:09 user nova-compute[72793]:       <entry name="serial">d4b8f681-6b81-49fe-8455-7564e2cafff7</entry>
Aug 17 04:12:09 user nova-compute[72793]:       <entry name="uuid">d4b8f681-6b81-49fe-8455-7564e2cafff7</entry>
Aug 17 04:12:09 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:12:09 user nova-compute[72793]:     </system>
Aug 17 04:12:09 user nova-compute[72793]:   </sysinfo>
Aug 17 04:12:09 user nova-compute[72793]:   <os>
Aug 17 04:12:09 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:12:09 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:12:09 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:12:09 user nova-compute[72793]:   </os>
Aug 17 04:12:09 user nova-compute[72793]:   <features>
Aug 17 04:12:09 user nova-compute[72793]:     <acpi/>
Aug 17 04:12:09 user nova-compute[72793]:     <apic/>
Aug 17 04:12:09 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:12:09 user nova-compute[72793]:   </features>
Aug 17 04:12:09 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:12:09 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:12:09 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:12:09 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:12:09 user nova-compute[72793]:   </clock>
Aug 17 04:12:09 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:12:09 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:12:09 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:12:09 user nova-compute[72793]:   </cpu>
Aug 17 04:12:09 user nova-compute[72793]:   <devices>
Aug 17 04:12:09 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:12:09 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:12:09 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:12:09 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:12:09 user nova-compute[72793]:       <serial>b3917248-1333-4826-b941-b7e0ab0c5ced</serial>
Aug 17 04:12:09 user nova-compute[72793]:     </disk>
Aug 17 04:12:09 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:12:09 user nova-compute[72793]:       <mac address="fa:16:3e:e7:cb:49"/>
Aug 17 04:12:09 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:09 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:12:09 user nova-compute[72793]:       <target dev="tape765bd5a-bd"/>
Aug 17 04:12:09 user nova-compute[72793]:     </interface>
Aug 17 04:12:09 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:12:09 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7/console.log" append="off"/>
Aug 17 04:12:09 user nova-compute[72793]:     </serial>
Aug 17 04:12:09 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:12:09 user nova-compute[72793]:     <video>
Aug 17 04:12:09 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:09 user nova-compute[72793]:     </video>
Aug 17 04:12:09 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:12:09 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:12:09 user nova-compute[72793]:     </rng>
Aug 17 04:12:09 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:12:09 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:12:09 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:12:09 user nova-compute[72793]:     </memballoon>
Aug 17 04:12:09 user nova-compute[72793]:   </devices>
Aug 17 04:12:09 user nova-compute[72793]: </domain>
Aug 17 04:12:09 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1324529661',display_name='tempest-TestShelveInstance-server-1324529661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1324529661',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-567723049',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='29f31f57bb7f4b90b0f9d018a662c6e1',ramdisk_id='',reservation_id='r-jb4ngety',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-278994045',owner_user_name='tempest-TestShelveInstance-278994045-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:11:53Z,user_data=None,user_id='ddc21d6c97ef4b4a982b4011e9ebd13b',uuid=d4b8f681-6b81-49fe-8455-7564e2cafff7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converting VIF {"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG os_vif [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape765bd5a-bd, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape765bd5a-bd, col_values=(('external_ids', {'iface-id': 'e765bd5a-bdb6-4f7f-809b-fea1940e60b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:cb:49', 'vm-uuid': 'd4b8f681-6b81-49fe-8455-7564e2cafff7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:09 user nova-compute[72793]: INFO os_vif [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd')
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:12:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] No VIF found with MAC fa:16:3e:e7:cb:49, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:12:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Snapshot image upload complete
Aug 17 04:12:10 user nova-compute[72793]: INFO nova.compute.manager [None req-29175c62-aaa8-4186-818c-07c03e4d91ec tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Took 6.87 seconds to snapshot the instance on the hypervisor.
Aug 17 04:12:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:10 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-bcde6599-ef19-4d67-9b68-db20091a4ed2 req-66b5aabc-c3fd-4a92-bd3e-c33ad0989e48 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bcde6599-ef19-4d67-9b68-db20091a4ed2 req-66b5aabc-c3fd-4a92-bd3e-c33ad0989e48 service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bcde6599-ef19-4d67-9b68-db20091a4ed2 req-66b5aabc-c3fd-4a92-bd3e-c33ad0989e48 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bcde6599-ef19-4d67-9b68-db20091a4ed2 req-66b5aabc-c3fd-4a92-bd3e-c33ad0989e48 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-bcde6599-ef19-4d67-9b68-db20091a4ed2 req-66b5aabc-c3fd-4a92-bd3e-c33ad0989e48 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:11 user nova-compute[72793]: WARNING nova.compute.manager [req-bcde6599-ef19-4d67-9b68-db20091a4ed2 req-66b5aabc-c3fd-4a92-bd3e-c33ad0989e48 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 04:12:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:12 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245517.5558603, 758b73d6-9b4c-46cc-be56-a17f56709cf4 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:12 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] VM Stopped (Lifecycle Event)
Aug 17 04:12:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10e8d55a-52bf-499d-bc77-9f1665b941a9 None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10e8d55a-52bf-499d-bc77-9f1665b941a9 None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:12 user nova-compute[72793]: INFO nova.compute.manager [None req-10e8d55a-52bf-499d-bc77-9f1665b941a9 None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 04:12:12 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:12 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-d0d979f0-bcc1-436b-a543-5de8134e340b req-7e4e84fb-1e8f-48e9-ac07-d320fd1b6b83 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d0d979f0-bcc1-436b-a543-5de8134e340b req-7e4e84fb-1e8f-48e9-ac07-d320fd1b6b83 service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d0d979f0-bcc1-436b-a543-5de8134e340b req-7e4e84fb-1e8f-48e9-ac07-d320fd1b6b83 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d0d979f0-bcc1-436b-a543-5de8134e340b req-7e4e84fb-1e8f-48e9-ac07-d320fd1b6b83 service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-d0d979f0-bcc1-436b-a543-5de8134e340b req-7e4e84fb-1e8f-48e9-ac07-d320fd1b6b83 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:13 user nova-compute[72793]: WARNING nova.compute.manager [req-d0d979f0-bcc1-436b-a543-5de8134e340b req-7e4e84fb-1e8f-48e9-ac07-d320fd1b6b83 service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245533.8790574, d4b8f681-6b81-49fe-8455-7564e2cafff7 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] VM Resumed (Lifecycle Event)
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:12:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance spawned successfully.
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245533.8798249, d4b8f681-6b81-49fe-8455-7564e2cafff7 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] VM Started (Lifecycle Event)
Aug 17 04:12:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e182fb4d-5964-4f79-b9ff-a0ab569e76c8 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.521s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Starting finish_migration {{(pid=72793) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:12:14 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Creating image(s)
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Ensure instance console log exists: /opt/stack/data/nova/instances/758b73d6-9b4c-46cc-be56-a17f56709cf4/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Start _get_guest_xml network_info=[{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '758b73d6-9b4c-46cc-be56-a17f56709cf4', 'attached_at': '2023-08-17T04:12:14.000000', 'detached_at': '', 'volume_id': '06eeb596-a6d1-4bd6-b628-8ef789462193', 'serial': '06eeb596-a6d1-4bd6-b628-8ef789462193'}, 'guest_format': None, 'attachment_id': '8d11db7e-3ff6-44f5-b490-9dc0e00ecc14', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:14 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'vcpu_model' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:12:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:12:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:12:14 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49f96f-0520-419e-92d7-83dd8a2cd97d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:12:14 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d887e523-75e7-4b10-aa51-77470596bfb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193] added
Aug 17 04:12:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad52a6-89f0-45fc-94c4-427c9410ac6c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9003ff96-6a70-4558-8c52-1e9c747415e8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVGusNEl {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVGusNEl" returned: 0 in 0.040s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe14d8a-9798-47e5-b0c6-2325e38091d1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVGusNEl'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1422876-faa5-4f90-9af5-cef196e03e17]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d852e-cd97-468d-ab56-a17ace84c2ea]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:14 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:12:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:14 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:12:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02ad64-81da-49cb-bbab-e85b15dab11d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]
Aug 17 04:12:14 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.
Aug 17 04:12:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac77c48-4afc-4bfc-9781-5950c6344089]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2cea2f-0a11-48e8-82d4-4fb2db32b644]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:14 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:12:14 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:12:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:12:14 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:12:14 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:12:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcab250-5a65-457b-9e7f-65de332f6eb8]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23239343561626135', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239343561626135', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1382367539',display_name='tempest-ServerActionsTestOtherA-server-1382367539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1382367539',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-0388eifl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=758b73d6-9b4c-46cc-be56-a17f56709cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:12:15 user nova-compute[72793]:   <uuid>758b73d6-9b4c-46cc-be56-a17f56709cf4</uuid>
Aug 17 04:12:15 user nova-compute[72793]:   <name>instance-0000001d</name>
Aug 17 04:12:15 user nova-compute[72793]:   <memory>2097152</memory>
Aug 17 04:12:15 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:12:15 user nova-compute[72793]:   <metadata>
Aug 17 04:12:15 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:12:15 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:12:15 user nova-compute[72793]:       <nova:name>tempest-ServerActionsTestOtherA-server-1382367539</nova:name>
Aug 17 04:12:15 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:12:14</nova:creationTime>
Aug 17 04:12:15 user nova-compute[72793]:       <nova:flavor name="m1.small">
Aug 17 04:12:15 user nova-compute[72793]:         <nova:memory>2048</nova:memory>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:disk>20</nova:disk>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:12:15 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:12:15 user nova-compute[72793]:       <nova:owner>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:user uuid="65891e5eae334ee38675df619856db02">tempest-ServerActionsTestOtherA-1498578162-project-member</nova:user>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:project uuid="8c6b688c6c95499ab90009d73f378a92">tempest-ServerActionsTestOtherA-1498578162</nova:project>
Aug 17 04:12:15 user nova-compute[72793]:       </nova:owner>
Aug 17 04:12:15 user nova-compute[72793]:       <nova:ports>
Aug 17 04:12:15 user nova-compute[72793]:         <nova:port uuid="136a24c8-e601-4edb-8343-e60ad8e27bd5">
Aug 17 04:12:15 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 04:12:15 user nova-compute[72793]:         </nova:port>
Aug 17 04:12:15 user nova-compute[72793]:       </nova:ports>
Aug 17 04:12:15 user nova-compute[72793]:     </nova:instance>
Aug 17 04:12:15 user nova-compute[72793]:   </metadata>
Aug 17 04:12:15 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:12:15 user nova-compute[72793]:     <system>
Aug 17 04:12:15 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:12:15 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:12:15 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:12:15 user nova-compute[72793]:       <entry name="serial">758b73d6-9b4c-46cc-be56-a17f56709cf4</entry>
Aug 17 04:12:15 user nova-compute[72793]:       <entry name="uuid">758b73d6-9b4c-46cc-be56-a17f56709cf4</entry>
Aug 17 04:12:15 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:12:15 user nova-compute[72793]:     </system>
Aug 17 04:12:15 user nova-compute[72793]:   </sysinfo>
Aug 17 04:12:15 user nova-compute[72793]:   <os>
Aug 17 04:12:15 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:12:15 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:12:15 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:12:15 user nova-compute[72793]:   </os>
Aug 17 04:12:15 user nova-compute[72793]:   <features>
Aug 17 04:12:15 user nova-compute[72793]:     <acpi/>
Aug 17 04:12:15 user nova-compute[72793]:     <apic/>
Aug 17 04:12:15 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:12:15 user nova-compute[72793]:   </features>
Aug 17 04:12:15 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:12:15 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:12:15 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:12:15 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:12:15 user nova-compute[72793]:   </clock>
Aug 17 04:12:15 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:12:15 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:12:15 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:12:15 user nova-compute[72793]:   </cpu>
Aug 17 04:12:15 user nova-compute[72793]:   <devices>
Aug 17 04:12:15 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:12:15 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:12:15 user nova-compute[72793]:       <source dev="/dev/sdc"/>
Aug 17 04:12:15 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:12:15 user nova-compute[72793]:       <serial>06eeb596-a6d1-4bd6-b628-8ef789462193</serial>
Aug 17 04:12:15 user nova-compute[72793]:     </disk>
Aug 17 04:12:15 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:12:15 user nova-compute[72793]:       <mac address="fa:16:3e:5b:97:0b"/>
Aug 17 04:12:15 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:15 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:12:15 user nova-compute[72793]:       <target dev="tap136a24c8-e6"/>
Aug 17 04:12:15 user nova-compute[72793]:     </interface>
Aug 17 04:12:15 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:12:15 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/758b73d6-9b4c-46cc-be56-a17f56709cf4/console.log" append="off"/>
Aug 17 04:12:15 user nova-compute[72793]:     </serial>
Aug 17 04:12:15 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:12:15 user nova-compute[72793]:     <video>
Aug 17 04:12:15 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:15 user nova-compute[72793]:     </video>
Aug 17 04:12:15 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:12:15 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:12:15 user nova-compute[72793]:     </rng>
Aug 17 04:12:15 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:12:15 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:12:15 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:12:15 user nova-compute[72793]:     </memballoon>
Aug 17 04:12:15 user nova-compute[72793]:   </devices>
Aug 17 04:12:15 user nova-compute[72793]: </domain>
Aug 17 04:12:15 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1382367539',display_name='tempest-ServerActionsTestOtherA-server-1382367539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1382367539',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-0388eifl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=758b73d6-9b4c-46cc-be56-a17f56709cf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-413533841-network", "vif_mac": "fa:16:3e:5b:97:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG os_vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap136a24c8-e6, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap136a24c8-e6, col_values=(('external_ids', {'iface-id': '136a24c8-e601-4edb-8343-e60ad8e27bd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:97:0b', 'vm-uuid': '758b73d6-9b4c-46cc-be56-a17f56709cf4'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:15 user nova-compute[72793]: INFO os_vif [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6')
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:12:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] No VIF found with MAC fa:16:3e:5b:97:0b, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:12:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.301s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:12:17 user nova-compute[72793]: INFO nova.compute.claims [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Claim successful on node user
Aug 17 04:12:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-634fcf69-f143-450b-b502-33f2100af94b req-81e50ca3-1f96-419e-9150-d45aec316996 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-634fcf69-f143-450b-b502-33f2100af94b req-81e50ca3-1f96-419e-9150-d45aec316996 service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-634fcf69-f143-450b-b502-33f2100af94b req-81e50ca3-1f96-419e-9150-d45aec316996 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-634fcf69-f143-450b-b502-33f2100af94b req-81e50ca3-1f96-419e-9150-d45aec316996 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-634fcf69-f143-450b-b502-33f2100af94b req-81e50ca3-1f96-419e-9150-d45aec316996 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:18 user nova-compute[72793]: WARNING nova.compute.manager [req-634fcf69-f143-450b-b502-33f2100af94b req-81e50ca3-1f96-419e-9150-d45aec316996 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state active and task_state resize_finish.
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.961s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:18 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:12:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:12:18 user nova-compute[72793]: DEBUG nova.policy [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec6ad70b73a9436387c6d5812b30d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5df793fe4f43b6aa166ea78757d6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:12:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Creating image(s)
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "/opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "/opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "/opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.276s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Successfully created port: 4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.904s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c752c66-e0b5-442a-88a8-095fb6c4b493 req-95a826a6-1665-44d5-b9ae-b1887dc59350 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c752c66-e0b5-442a-88a8-095fb6c4b493 req-95a826a6-1665-44d5-b9ae-b1887dc59350 service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c752c66-e0b5-442a-88a8-095fb6c4b493 req-95a826a6-1665-44d5-b9ae-b1887dc59350 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6c752c66-e0b5-442a-88a8-095fb6c4b493 req-95a826a6-1665-44d5-b9ae-b1887dc59350 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-6c752c66-e0b5-442a-88a8-095fb6c4b493 req-95a826a6-1665-44d5-b9ae-b1887dc59350 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:20 user nova-compute[72793]: WARNING nova.compute.manager [req-6c752c66-e0b5-442a-88a8-095fb6c4b493 req-95a826a6-1665-44d5-b9ae-b1887dc59350 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state active and task_state resize_finish.
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk 1073741824" returned: 0 in 0.072s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.981s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7607MB free_disk=25.275634765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Applying migration context for instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 as it has an incoming, in-progress migration 3ad4a698-6952-43aa-8352-d532881632f7. Migration status is post-migrating {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 04:12:20 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating resource usage from migration 3ad4a698-6952-43aa-8352-d532881632f7
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245540.6865559, 758b73d6-9b4c-46cc-be56-a17f56709cf4 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:20 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] VM Resumed (Lifecycle Event)
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ffa2387-a317-4b02-90be-797d8de5c6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d4b8f681-6b81-49fe-8455-7564e2cafff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Migration 3ad4a698-6952-43aa-8352-d532881632f7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.284s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:20 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance running successfully.
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Failed to set time: agent not configured {{(pid=72793) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8f72763a-7452-41cc-805c-51fb29ac87ce tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] finish_migration finished successfully. {{(pid=72793) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 04:12:20 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245540.6963358, 758b73d6-9b4c-46cc-be56-a17f56709cf4 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:20 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] VM Started (Lifecycle Event)
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:20 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 04:12:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Cannot resize image /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:12:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'migration_context' on Instance uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Ensure instance console log exists: /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.856s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Successfully updated port: 4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquired lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-changed-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Refreshing instance network info cache due to event network-changed-4823d2d4-0910-44e5-921b-e81019dede34. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] Acquiring lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:12:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updating instance_info_cache with network_info: [{"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Releasing lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Instance network_info: |[{"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] Acquired lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Refreshing network info cache for port 4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Start _get_guest_xml network_info=[{"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:12:22 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:22 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-486250876',display_name='tempest-TestStampPattern-server-486250876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-486250876',id=32,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqB9t/3sSVxFk9/g96xP3rSFx0LEd2VPNOmRyPR0ztCb9JD+Im4SIlqAcSlRg4TJTgiGLSOyiJ+Bqo6d7fO59SFjP1HSGL8I2vjXUN6yYYLnoGGfgGlKAbcF/3Sh8woWw==',key_name='tempest-TestStampPattern-408149894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5df793fe4f43b6aa166ea78757d6c5',ramdisk_id='',reservation_id='r-6g7pvmv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-174584011',owner_user_name='tempest-TestStampPattern-174584011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:12:19Z,user_data=None,user_id='ec6ad70b73a9436387c6d5812b30d1f5',uuid=5324b34b-1ce3-41c7-b3f3-47156e936a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converting VIF {"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.objects.instance [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'pci_devices' on Instance uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:12:22 user nova-compute[72793]:   <uuid>5324b34b-1ce3-41c7-b3f3-47156e936a33</uuid>
Aug 17 04:12:22 user nova-compute[72793]:   <name>instance-00000020</name>
Aug 17 04:12:22 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:12:22 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:12:22 user nova-compute[72793]:   <metadata>
Aug 17 04:12:22 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:12:22 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:12:22 user nova-compute[72793]:       <nova:name>tempest-TestStampPattern-server-486250876</nova:name>
Aug 17 04:12:22 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:12:22</nova:creationTime>
Aug 17 04:12:22 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:12:22 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:12:22 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:12:22 user nova-compute[72793]:       <nova:owner>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:user uuid="ec6ad70b73a9436387c6d5812b30d1f5">tempest-TestStampPattern-174584011-project-member</nova:user>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:project uuid="6d5df793fe4f43b6aa166ea78757d6c5">tempest-TestStampPattern-174584011</nova:project>
Aug 17 04:12:22 user nova-compute[72793]:       </nova:owner>
Aug 17 04:12:22 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:12:22 user nova-compute[72793]:       <nova:ports>
Aug 17 04:12:22 user nova-compute[72793]:         <nova:port uuid="4823d2d4-0910-44e5-921b-e81019dede34">
Aug 17 04:12:22 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 04:12:22 user nova-compute[72793]:         </nova:port>
Aug 17 04:12:22 user nova-compute[72793]:       </nova:ports>
Aug 17 04:12:22 user nova-compute[72793]:     </nova:instance>
Aug 17 04:12:22 user nova-compute[72793]:   </metadata>
Aug 17 04:12:22 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:12:22 user nova-compute[72793]:     <system>
Aug 17 04:12:22 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:12:22 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:12:22 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:12:22 user nova-compute[72793]:       <entry name="serial">5324b34b-1ce3-41c7-b3f3-47156e936a33</entry>
Aug 17 04:12:22 user nova-compute[72793]:       <entry name="uuid">5324b34b-1ce3-41c7-b3f3-47156e936a33</entry>
Aug 17 04:12:22 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:12:22 user nova-compute[72793]:     </system>
Aug 17 04:12:22 user nova-compute[72793]:   </sysinfo>
Aug 17 04:12:22 user nova-compute[72793]:   <os>
Aug 17 04:12:22 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:12:22 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:12:22 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:12:22 user nova-compute[72793]:   </os>
Aug 17 04:12:22 user nova-compute[72793]:   <features>
Aug 17 04:12:22 user nova-compute[72793]:     <acpi/>
Aug 17 04:12:22 user nova-compute[72793]:     <apic/>
Aug 17 04:12:22 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:12:22 user nova-compute[72793]:   </features>
Aug 17 04:12:22 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:12:22 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:12:22 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:12:22 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:12:22 user nova-compute[72793]:   </clock>
Aug 17 04:12:22 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:12:22 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:12:22 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:12:22 user nova-compute[72793]:   </cpu>
Aug 17 04:12:22 user nova-compute[72793]:   <devices>
Aug 17 04:12:22 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:12:22 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:12:22 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk"/>
Aug 17 04:12:22 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:12:22 user nova-compute[72793]:     </disk>
Aug 17 04:12:22 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:12:22 user nova-compute[72793]:       <mac address="fa:16:3e:cd:92:33"/>
Aug 17 04:12:22 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:22 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:12:22 user nova-compute[72793]:       <target dev="tap4823d2d4-09"/>
Aug 17 04:12:22 user nova-compute[72793]:     </interface>
Aug 17 04:12:22 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:12:22 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/console.log" append="off"/>
Aug 17 04:12:22 user nova-compute[72793]:     </serial>
Aug 17 04:12:22 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:12:22 user nova-compute[72793]:     <video>
Aug 17 04:12:22 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:22 user nova-compute[72793]:     </video>
Aug 17 04:12:22 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:12:22 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:12:22 user nova-compute[72793]:     </rng>
Aug 17 04:12:22 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:12:22 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:12:22 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:12:22 user nova-compute[72793]:     </memballoon>
Aug 17 04:12:22 user nova-compute[72793]:   </devices>
Aug 17 04:12:22 user nova-compute[72793]: </domain>
Aug 17 04:12:22 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-486250876',display_name='tempest-TestStampPattern-server-486250876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-486250876',id=32,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqB9t/3sSVxFk9/g96xP3rSFx0LEd2VPNOmRyPR0ztCb9JD+Im4SIlqAcSlRg4TJTgiGLSOyiJ+Bqo6d7fO59SFjP1HSGL8I2vjXUN6yYYLnoGGfgGlKAbcF/3Sh8woWw==',key_name='tempest-TestStampPattern-408149894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5df793fe4f43b6aa166ea78757d6c5',ramdisk_id='',reservation_id='r-6g7pvmv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-174584011',owner_user_name='tempest-TestStampPattern-174584011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:12:19Z,user_data=None,user_id='ec6ad70b73a9436387c6d5812b30d1f5',uuid=5324b34b-1ce3-41c7-b3f3-47156e936a33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converting VIF {"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG os_vif [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4823d2d4-09, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4823d2d4-09, col_values=(('external_ids', {'iface-id': '4823d2d4-0910-44e5-921b-e81019dede34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:92:33', 'vm-uuid': '5324b34b-1ce3-41c7-b3f3-47156e936a33'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:22 user nova-compute[72793]: INFO os_vif [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09')
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No VIF found with MAC fa:16:3e:cd:92:33, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updated VIF entry in instance network info cache for port 4823d2d4-0910-44e5-921b-e81019dede34. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updating instance_info_cache with network_info: [{"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-39c89270-f400-4a99-95db-25dc9cb7231e req-6b8854c7-e7cf-4957-ae40-12b99825a662 service nova] Releasing lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG nova.compute.manager [req-5ad72b6b-e437-4c91-aef8-3392d450645e req-bbca96d2-d831-4ee5-bccc-93494cb69bfe service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5ad72b6b-e437-4c91-aef8-3392d450645e req-bbca96d2-d831-4ee5-bccc-93494cb69bfe service nova] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5ad72b6b-e437-4c91-aef8-3392d450645e req-bbca96d2-d831-4ee5-bccc-93494cb69bfe service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5ad72b6b-e437-4c91-aef8-3392d450645e req-bbca96d2-d831-4ee5-bccc-93494cb69bfe service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG nova.compute.manager [req-5ad72b6b-e437-4c91-aef8-3392d450645e req-bbca96d2-d831-4ee5-bccc-93494cb69bfe service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] No waiting events found dispatching network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:24 user nova-compute[72793]: WARNING nova.compute.manager [req-5ad72b6b-e437-4c91-aef8-3392d450645e req-bbca96d2-d831-4ee5-bccc-93494cb69bfe service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received unexpected event network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 for instance with vm_state building and task_state spawning.
Aug 17 04:12:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245546.1164238, 5324b34b-1ce3-41c7-b3f3-47156e936a33 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] VM Resumed (Lifecycle Event)
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Instance spawned successfully.
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-84c0d34e-be47-459e-9190-2d8119c34223 req-ddc4a7e1-031f-424b-9fb2-2b58454861b1 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84c0d34e-be47-459e-9190-2d8119c34223 req-ddc4a7e1-031f-424b-9fb2-2b58454861b1 service nova] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84c0d34e-be47-459e-9190-2d8119c34223 req-ddc4a7e1-031f-424b-9fb2-2b58454861b1 service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84c0d34e-be47-459e-9190-2d8119c34223 req-ddc4a7e1-031f-424b-9fb2-2b58454861b1 service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-84c0d34e-be47-459e-9190-2d8119c34223 req-ddc4a7e1-031f-424b-9fb2-2b58454861b1 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] No waiting events found dispatching network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:26 user nova-compute[72793]: WARNING nova.compute.manager [req-84c0d34e-be47-459e-9190-2d8119c34223 req-ddc4a7e1-031f-424b-9fb2-2b58454861b1 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received unexpected event network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 for instance with vm_state building and task_state spawning.
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245546.1195362, 5324b34b-1ce3-41c7-b3f3-47156e936a33 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] VM Started (Lifecycle Event)
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 17 04:12:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:26 user nova-compute[72793]: INFO nova.compute.manager [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Took 8.80 seconds to build instance.
Aug 17 04:12:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-402fa672-6ff9-406a-8644-e1ff9fc374f2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.935s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "ef52ab14-abca-42c8-8266-204444ede656" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:12:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:12:39 user nova-compute[72793]: INFO nova.compute.claims [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Claim successful on node user
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.policy [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad60fa5186024d2e8c03a99d8b90834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff1feab57f4390be7855b073d7c634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:12:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:12:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Creating image(s)
Aug 17 04:12:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "/opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "/opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk 1073741824" returned: 0 in 0.060s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Successfully created port: 71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Cannot resize image /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lazy-loading 'migration_context' on Instance uuid ef52ab14-abca-42c8-8266-204444ede656 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Ensure instance console log exists: /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Successfully updated port: 71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquired lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-changed-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Refreshing instance network info cache due to event network-changed-71833219-beb7-41f4-87da-78b2de88b10b. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] Acquiring lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Updating instance_info_cache with network_info: [{"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Releasing lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Instance network_info: |[{"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] Acquired lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.neutron [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Refreshing network info cache for port 71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Start _get_guest_xml network_info=[{"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:12:42 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:42 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-791223120',display_name='tempest-ServersNegativeTestJSON-server-791223120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-791223120',id=33,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ff1feab57f4390be7855b073d7c634',ramdisk_id='',reservation_id='r-7oeylftw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-698989669',owner_user_name='tempest-ServersNegativeTestJSON-698989669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:12:41Z,user_data=None,user_id='ad60fa5186024d2e8c03a99d8b90834a',uuid=ef52ab14-abca-42c8-8266-204444ede656,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converting VIF {"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lazy-loading 'pci_devices' on Instance uuid ef52ab14-abca-42c8-8266-204444ede656 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:12:42 user nova-compute[72793]:   <uuid>ef52ab14-abca-42c8-8266-204444ede656</uuid>
Aug 17 04:12:42 user nova-compute[72793]:   <name>instance-00000021</name>
Aug 17 04:12:42 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:12:42 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:12:42 user nova-compute[72793]:   <metadata>
Aug 17 04:12:42 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:12:42 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:12:42 user nova-compute[72793]:       <nova:name>tempest-ServersNegativeTestJSON-server-791223120</nova:name>
Aug 17 04:12:42 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:12:42</nova:creationTime>
Aug 17 04:12:42 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:12:42 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:12:42 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:12:42 user nova-compute[72793]:       <nova:owner>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:user uuid="ad60fa5186024d2e8c03a99d8b90834a">tempest-ServersNegativeTestJSON-698989669-project-member</nova:user>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:project uuid="13ff1feab57f4390be7855b073d7c634">tempest-ServersNegativeTestJSON-698989669</nova:project>
Aug 17 04:12:42 user nova-compute[72793]:       </nova:owner>
Aug 17 04:12:42 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:12:42 user nova-compute[72793]:       <nova:ports>
Aug 17 04:12:42 user nova-compute[72793]:         <nova:port uuid="71833219-beb7-41f4-87da-78b2de88b10b">
Aug 17 04:12:42 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:12:42 user nova-compute[72793]:         </nova:port>
Aug 17 04:12:42 user nova-compute[72793]:       </nova:ports>
Aug 17 04:12:42 user nova-compute[72793]:     </nova:instance>
Aug 17 04:12:42 user nova-compute[72793]:   </metadata>
Aug 17 04:12:42 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:12:42 user nova-compute[72793]:     <system>
Aug 17 04:12:42 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:12:42 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:12:42 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:12:42 user nova-compute[72793]:       <entry name="serial">ef52ab14-abca-42c8-8266-204444ede656</entry>
Aug 17 04:12:42 user nova-compute[72793]:       <entry name="uuid">ef52ab14-abca-42c8-8266-204444ede656</entry>
Aug 17 04:12:42 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:12:42 user nova-compute[72793]:     </system>
Aug 17 04:12:42 user nova-compute[72793]:   </sysinfo>
Aug 17 04:12:42 user nova-compute[72793]:   <os>
Aug 17 04:12:42 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:12:42 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:12:42 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:12:42 user nova-compute[72793]:   </os>
Aug 17 04:12:42 user nova-compute[72793]:   <features>
Aug 17 04:12:42 user nova-compute[72793]:     <acpi/>
Aug 17 04:12:42 user nova-compute[72793]:     <apic/>
Aug 17 04:12:42 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:12:42 user nova-compute[72793]:   </features>
Aug 17 04:12:42 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:12:42 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:12:42 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:12:42 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:12:42 user nova-compute[72793]:   </clock>
Aug 17 04:12:42 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:12:42 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:12:42 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:12:42 user nova-compute[72793]:   </cpu>
Aug 17 04:12:42 user nova-compute[72793]:   <devices>
Aug 17 04:12:42 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:12:42 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:12:42 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk"/>
Aug 17 04:12:42 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:12:42 user nova-compute[72793]:     </disk>
Aug 17 04:12:42 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:12:42 user nova-compute[72793]:       <mac address="fa:16:3e:71:f0:05"/>
Aug 17 04:12:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:42 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:12:42 user nova-compute[72793]:       <target dev="tap71833219-be"/>
Aug 17 04:12:42 user nova-compute[72793]:     </interface>
Aug 17 04:12:42 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:12:42 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/console.log" append="off"/>
Aug 17 04:12:42 user nova-compute[72793]:     </serial>
Aug 17 04:12:42 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:12:42 user nova-compute[72793]:     <video>
Aug 17 04:12:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:12:42 user nova-compute[72793]:     </video>
Aug 17 04:12:42 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:12:42 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:12:42 user nova-compute[72793]:     </rng>
Aug 17 04:12:42 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:12:42 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:12:42 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:12:42 user nova-compute[72793]:     </memballoon>
Aug 17 04:12:42 user nova-compute[72793]:   </devices>
Aug 17 04:12:42 user nova-compute[72793]: </domain>
Aug 17 04:12:42 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-791223120',display_name='tempest-ServersNegativeTestJSON-server-791223120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-791223120',id=33,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ff1feab57f4390be7855b073d7c634',ramdisk_id='',reservation_id='r-7oeylftw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-698989669',owner_user_name='tempest-ServersNegativeTestJSON-698989669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:12:41Z,user_data=None,user_id='ad60fa5186024d2e8c03a99d8b90834a',uuid=ef52ab14-abca-42c8-8266-204444ede656,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converting VIF {"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG os_vif [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71833219-be, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71833219-be, col_values=(('external_ids', {'iface-id': '71833219-beb7-41f4-87da-78b2de88b10b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:f0:05', 'vm-uuid': 'ef52ab14-abca-42c8-8266-204444ede656'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:42 user nova-compute[72793]: INFO os_vif [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be')
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:12:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] No VIF found with MAC fa:16:3e:71:f0:05, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:12:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Updated VIF entry in instance network info cache for port 71833219-beb7-41f4-87da-78b2de88b10b. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:12:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Updating instance_info_cache with network_info: [{"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:12:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e32afaf4-aa91-4ea1-9b1d-d5d6d4943a2c req-07831fb8-8fa2-4dc8-8736-4fa63f9b2b92 service nova] Releasing lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-031f74a9-e8b8-4dc1-8baa-d2c3e103d4f9 req-b5189465-14cf-4faf-a2c1-f3fa39a2b93c service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-031f74a9-e8b8-4dc1-8baa-d2c3e103d4f9 req-b5189465-14cf-4faf-a2c1-f3fa39a2b93c service nova] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-031f74a9-e8b8-4dc1-8baa-d2c3e103d4f9 req-b5189465-14cf-4faf-a2c1-f3fa39a2b93c service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-031f74a9-e8b8-4dc1-8baa-d2c3e103d4f9 req-b5189465-14cf-4faf-a2c1-f3fa39a2b93c service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-031f74a9-e8b8-4dc1-8baa-d2c3e103d4f9 req-b5189465-14cf-4faf-a2c1-f3fa39a2b93c service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] No waiting events found dispatching network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:44 user nova-compute[72793]: WARNING nova.compute.manager [req-031f74a9-e8b8-4dc1-8baa-d2c3e103d4f9 req-b5189465-14cf-4faf-a2c1-f3fa39a2b93c service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received unexpected event network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b for instance with vm_state building and task_state spawning.
Aug 17 04:12:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245566.5054505, ef52ab14-abca-42c8-8266-204444ede656 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] VM Resumed (Lifecycle Event)
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] Instance spawned successfully.
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245566.5137925, ef52ab14-abca-42c8-8266-204444ede656 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] VM Started (Lifecycle Event)
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-114c8c1d-b283-4322-a147-118687d3cc23 req-df04ac93-013b-453e-a686-49df40f6a3a7 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-114c8c1d-b283-4322-a147-118687d3cc23 req-df04ac93-013b-453e-a686-49df40f6a3a7 service nova] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-114c8c1d-b283-4322-a147-118687d3cc23 req-df04ac93-013b-453e-a686-49df40f6a3a7 service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-114c8c1d-b283-4322-a147-118687d3cc23 req-df04ac93-013b-453e-a686-49df40f6a3a7 service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-114c8c1d-b283-4322-a147-118687d3cc23 req-df04ac93-013b-453e-a686-49df40f6a3a7 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] No waiting events found dispatching network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:12:46 user nova-compute[72793]: WARNING nova.compute.manager [req-114c8c1d-b283-4322-a147-118687d3cc23 req-df04ac93-013b-453e-a686-49df40f6a3a7 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received unexpected event network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b for instance with vm_state building and task_state spawning.
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 17 04:12:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:12:46 user nova-compute[72793]: INFO nova.compute.manager [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Took 6.82 seconds to build instance.
Aug 17 04:12:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-be6b0e5b-3d85-459a-bc52-8d7bc5bac1be tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "ef52ab14-abca-42c8-8266-204444ede656" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.927s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:12:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:12:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing instance network info cache due to event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:13:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updated VIF entry in instance network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6f3a442b-98ef-4c4e-94b2-3e19e625d56a req-672b24e7-42c8-44c3-921a-de5f9c431e4f service nova] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:13:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:07 user nova-compute[72793]: INFO nova.compute.manager [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Shelving
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-9ac5190e-03e0-489b-8401-f2481b7c5302 req-4e44fd71-3f9d-4d87-9501-099cd0d11c46 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-unplugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9ac5190e-03e0-489b-8401-f2481b7c5302 req-4e44fd71-3f9d-4d87-9501-099cd0d11c46 service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9ac5190e-03e0-489b-8401-f2481b7c5302 req-4e44fd71-3f9d-4d87-9501-099cd0d11c46 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9ac5190e-03e0-489b-8401-f2481b7c5302 req-4e44fd71-3f9d-4d87-9501-099cd0d11c46 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-9ac5190e-03e0-489b-8401-f2481b7c5302 req-4e44fd71-3f9d-4d87-9501-099cd0d11c46 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-unplugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:07 user nova-compute[72793]: WARNING nova.compute.manager [req-9ac5190e-03e0-489b-8401-f2481b7c5302 req-4e44fd71-3f9d-4d87-9501-099cd0d11c46 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-unplugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state active and task_state shelving.
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance destroyed successfully.
Aug 17 04:13:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Beginning cold snapshot process
Aug 17 04:13:08 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk /opt/stack/data/nova/instances/snapshots/tmpgnnyop1j/6306a25a3f4a4be080a30bd208f4c6aa {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk /opt/stack/data/nova/instances/snapshots/tmpgnnyop1j/6306a25a3f4a4be080a30bd208f4c6aa" returned: 0 in 0.807s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Snapshot extracted, beginning image upload
Aug 17 04:13:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa0b3a9c-b2d4-4626-bb2e-c93f2cdc97db req-8d07ab65-7809-4fbf-b925-6da3dd7f1d22 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa0b3a9c-b2d4-4626-bb2e-c93f2cdc97db req-8d07ab65-7809-4fbf-b925-6da3dd7f1d22 service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa0b3a9c-b2d4-4626-bb2e-c93f2cdc97db req-8d07ab65-7809-4fbf-b925-6da3dd7f1d22 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa0b3a9c-b2d4-4626-bb2e-c93f2cdc97db req-8d07ab65-7809-4fbf-b925-6da3dd7f1d22 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa0b3a9c-b2d4-4626-bb2e-c93f2cdc97db req-8d07ab65-7809-4fbf-b925-6da3dd7f1d22 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:09 user nova-compute[72793]: WARNING nova.compute.manager [req-aa0b3a9c-b2d4-4626-bb2e-c93f2cdc97db req-8d07ab65-7809-4fbf-b925-6da3dd7f1d22 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 04:13:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Snapshot image upload complete
Aug 17 04:13:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:11 user nova-compute[72793]: INFO nova.compute.manager [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Shelve offloading
Aug 17 04:13:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance destroyed successfully.
Aug 17 04:13:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:13:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:12 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance destroyed successfully.
Aug 17 04:13:12 user nova-compute[72793]: DEBUG nova.objects.instance [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'resources' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-362401097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-362401097',id=31,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzVcsyfpu/dNQgtTdJSiJg8n9aFu3HLg5KwUrSwfsJ+0by6pPeXq6kZOQYpp4+JC/c27Uwf6kkW6EMeQaf8xNjvNxpyQrPSQDS8jkeGXIVQTfh/yhdNm0M/dm/T+S3Wjg==',key_name='tempest-keypair-1719939993',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-k8m4wj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member',shelved_at='2023-08-17T04:13:11.307764',shelved_host='user',shelved_image_id='1df8469a-92a0-4dd0-b110-ada46ecd3f04'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:13:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=8ffa2387-a317-4b02-90be-797d8de5c6b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG os_vif [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing instance network info cache due to event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9fdf7ae-ef, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:13:13 user nova-compute[72793]: INFO os_vif [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef')
Aug 17 04:13:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Deleting instance files /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9_del
Aug 17 04:13:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Deletion of /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9_del complete
Aug 17 04:13:13 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Deleted allocations for instance 8ffa2387-a317-4b02-90be-797d8de5c6b9
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.objects.instance [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updated VIF entry in instance network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8b88f269-d961-4f82-8239-6a6b482efab7 req-97dad094-276d-41c6-a323-5ffdcb969aac service nova] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.432s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:13:13 user nova-compute[72793]: INFO nova.compute.claims [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Claim successful on node user
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-70c828c2-9bf9-45a7-8c84-841487571fc3 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.577s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:13:14 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:13:14 user nova-compute[72793]: INFO nova.virt.block_device [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Booting with volume-backed-image 5f4b4804-03ee-46d6-a29f-d5a8a50dfc98 at /dev/vda
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.policy [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21663e2118004c528a64a7fba2e29ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1ec39bbf61f45c6963f018159dcb33c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Successfully created port: cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Successfully updated port: cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-changed-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Refreshing instance network info cache due to event network-changed-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] Acquiring lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] Acquired lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Refreshing network info cache for port cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG nova.network.neutron [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG nova.network.neutron [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0cbe9039-70e7-4d31-9688-4a7c4c50540d req-7673ca0f-3fa7-4369-b8ec-f592a67c73d0 service nova] Releasing lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Updating instance_info_cache with network_info: [{"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance network_info: |[{"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:13:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:13:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7085MB free_disk=25.184452056884766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Applying migration context for instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 as it has an incoming, in-progress migration 3ad4a698-6952-43aa-8352-d532881632f7. Migration status is finished {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 04:13:19 user nova-compute[72793]: INFO nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating resource usage from migration 3ad4a698-6952-43aa-8352-d532881632f7
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d4b8f681-6b81-49fe-8455-7564e2cafff7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Migration 3ad4a698-6952-43aa-8352-d532881632f7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:19 user nova-compute[72793]: INFO nova.compute.manager [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Terminating instance
Aug 17 04:13:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-00293a67-7b54-4f60-b0a8-d3df99b10c55 req-854d0623-7a13-4b7d-a67e-3e737b58384c service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-vif-unplugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-00293a67-7b54-4f60-b0a8-d3df99b10c55 req-854d0623-7a13-4b7d-a67e-3e737b58384c service nova] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-00293a67-7b54-4f60-b0a8-d3df99b10c55 req-854d0623-7a13-4b7d-a67e-3e737b58384c service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-00293a67-7b54-4f60-b0a8-d3df99b10c55 req-854d0623-7a13-4b7d-a67e-3e737b58384c service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-00293a67-7b54-4f60-b0a8-d3df99b10c55 req-854d0623-7a13-4b7d-a67e-3e737b58384c service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] No waiting events found dispatching network-vif-unplugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-00293a67-7b54-4f60-b0a8-d3df99b10c55 req-854d0623-7a13-4b7d-a67e-3e737b58384c service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-vif-unplugged-2937b911-86f5-4338-a43e-97af2780da92 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:13:20 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Instance destroyed successfully.
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lazy-loading 'resources' on Instance uuid 28af729a-94d4-4e5f-ba09-98aa0b85ffed {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1038027461',display_name='tempest-TestMinimumBasicScenario-server-1038027461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1038027461',id=27,image_ref='940acbe3-b597-4a6b-81c9-964f843559c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDI9D926LLIZb+XIFkPSNB4DnPX26fgoFY3n30Xf+jYw2zksmahTwF62rlQaH/nhHYtq4Xe95SOngYTXix040rzkmpdl6JzuXcs73+3l8WUsYcYAMmVbMQpXBQ36gRFRQ==',key_name='tempest-TestMinimumBasicScenario-1840355347',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909f9614d1c64730bdcaf1b4d86516da',ramdisk_id='',reservation_id='r-zkuff2o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='940acbe3-b597-4a6b-81c9-964f843559c8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-660102196',owner_user_name='tempest-TestMinimumBasicScenario-660102196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:08:08Z,user_data=None,user_id='cd805a44490b4a969fd9121571f17bb1',uuid=28af729a-94d4-4e5f-ba09-98aa0b85ffed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converting VIF {"id": "2937b911-86f5-4338-a43e-97af2780da92", "address": "fa:16:3e:4b:0c:fe", "network": {"id": "b11e26ca-41b6-467a-bccc-fed998fa8eef", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-590374320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909f9614d1c64730bdcaf1b4d86516da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2937b911-86", "ovs_interfaceid": "2937b911-86f5-4338-a43e-97af2780da92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG os_vif [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2937b911-86, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:13:20 user nova-compute[72793]: INFO os_vif [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0c:fe,bridge_name='br-int',has_traffic_filtering=True,id=2937b911-86f5-4338-a43e-97af2780da92,network=Network(b11e26ca-41b6-467a-bccc-fed998fa8eef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2937b911-86')
Aug 17 04:13:20 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Deleting instance files /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed_del
Aug 17 04:13:20 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Deletion of /opt/stack/data/nova/instances/28af729a-94d4-4e5f-ba09-98aa0b85ffed_del complete
Aug 17 04:13:20 user nova-compute[72793]: INFO nova.compute.manager [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 17 04:13:20 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:13:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:21 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:21 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Took 0.86 seconds to deallocate network for instance.
Aug 17 04:13:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-6931d279-e7a9-4c10-900f-259f2cf2c21d req-db2aa4e8-f3a2-4149-9b9b-3de59c2bc481 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-vif-deleted-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:21 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Deleted allocations for instance 28af729a-94d4-4e5f-ba09-98aa0b85ffed
Aug 17 04:13:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa9719df-5fbc-497f-8da7-2f82dcc380b5 tempest-TestMinimumBasicScenario-660102196 tempest-TestMinimumBasicScenario-660102196-project-member] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.257s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-7901aaf5-cdb5-494f-a681-0edadfcbeb9e req-5a12931d-6ea2-4c93-92dc-cd60d73d0553 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received event network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7901aaf5-cdb5-494f-a681-0edadfcbeb9e req-5a12931d-6ea2-4c93-92dc-cd60d73d0553 service nova] Acquiring lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7901aaf5-cdb5-494f-a681-0edadfcbeb9e req-5a12931d-6ea2-4c93-92dc-cd60d73d0553 service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7901aaf5-cdb5-494f-a681-0edadfcbeb9e req-5a12931d-6ea2-4c93-92dc-cd60d73d0553 service nova] Lock "28af729a-94d4-4e5f-ba09-98aa0b85ffed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-7901aaf5-cdb5-494f-a681-0edadfcbeb9e req-5a12931d-6ea2-4c93-92dc-cd60d73d0553 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] No waiting events found dispatching network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:22 user nova-compute[72793]: WARNING nova.compute.manager [req-7901aaf5-cdb5-494f-a681-0edadfcbeb9e req-5a12931d-6ea2-4c93-92dc-cd60d73d0553 service nova] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Received unexpected event network-vif-plugged-2937b911-86f5-4338-a43e-97af2780da92 for instance with vm_state deleted and task_state None.
Aug 17 04:13:22 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245587.9494238, 8ffa2387-a317-4b02-90be-797d8de5c6b9 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:13:22 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] VM Stopped (Lifecycle Event)
Aug 17 04:13:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4184b506-9e01-4e00-a09e-e9883fcebe73 None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG os_brick.utils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[58667d40-dcc6-46a5-84b7-62c3c5736589]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef75678-dd8d-4c1f-a42b-e3975fa6d8a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cf40ad-5a33-4239-b2a3-e5a4eb123445]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4828dd87-374f-4761-9f6b-f1791b9215de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:13:30 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9854365-2945-4465-97dd-8b28d2336db1]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG os_brick.utils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Updating existing volume attachment record: abe3b402-8b09-4782-9af0-d079a22487cb {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:13:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:13:35 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245600.353193, 28af729a-94d4-4e5f-ba09-98aa0b85ffed => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:13:35 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] VM Stopped (Lifecycle Event)
Aug 17 04:13:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab6379b3-4eb5-4107-ab93-bd8b00d309c1 None None] [instance: 28af729a-94d4-4e5f-ba09-98aa0b85ffed] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:13:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Creating image(s)
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Ensure instance console log exists: /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Start _get_guest_xml network_info=[{"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3492c76f-a8cc-4db3-b2a8-6b661597d0ef', 'attached_at': '', 'detached_at': '', 'volume_id': '99b584d9-49e0-4b88-b15e-3c62260abe49', 'serial': '99b584d9-49e0-4b88-b15e-3c62260abe49'}, 'guest_format': None, 'attachment_id': 'abe3b402-8b09-4782-9af0-d079a22487cb', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:13:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:13:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:13:41 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:13:41 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:13:41 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5c5cfe-e4fc-48ae-b0fe-30a255c50a0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:13:41 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a7989-893f-4ae2-965c-60e4a443f85a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49] added
Aug 17 04:13:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3b05a-4f8d-4671-813a-2a04465895e4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb4ab77-abb4-4480-9ee7-5d17d5125faf]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrURuXpe {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrURuXpe" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c671c-0731-4c99-af00-1857272c0d62]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NrURuXpe'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bbb38f-061a-4340-b709-435e3dfc4f19]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9940a7-8c1a-4646-a58e-f4e40e66de95]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:13:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:13:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473f7f6-6a33-40c6-b79e-85fac21b7821]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260]
Aug 17 04:13:41 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260] successful.
Aug 17 04:13:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae48bb7-551b-4f17-830d-56480d1f7b98]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d596ea-bc7c-411e-9965-5cc6534d2be5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:13:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:13:41 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:13:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc5d764-9061-4bae-9eab-12abf52d614a]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:13:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26231346334383866', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231346334383866', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1716769912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1716769912',id=34,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-ka52pvdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:13:14Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=3492c76f-a8cc-4db3-b2a8-6b661597d0ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'pci_devices' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:13:42 user nova-compute[72793]:   <uuid>3492c76f-a8cc-4db3-b2a8-6b661597d0ef</uuid>
Aug 17 04:13:42 user nova-compute[72793]:   <name>instance-00000022</name>
Aug 17 04:13:42 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:13:42 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:13:42 user nova-compute[72793]:   <metadata>
Aug 17 04:13:42 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:13:42 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:13:42 user nova-compute[72793]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1716769912</nova:name>
Aug 17 04:13:42 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:13:41</nova:creationTime>
Aug 17 04:13:42 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:13:42 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:13:42 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:13:42 user nova-compute[72793]:       <nova:owner>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:user uuid="21663e2118004c528a64a7fba2e29ee3">tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member</nova:user>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:project uuid="a1ec39bbf61f45c6963f018159dcb33c">tempest-ServerBootFromVolumeStableRescueTest-1752371327</nova:project>
Aug 17 04:13:42 user nova-compute[72793]:       </nova:owner>
Aug 17 04:13:42 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:13:42 user nova-compute[72793]:       <nova:ports>
Aug 17 04:13:42 user nova-compute[72793]:         <nova:port uuid="cc9ec6ec-fc04-4a98-a2fa-1dce988ba746">
Aug 17 04:13:42 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 04:13:42 user nova-compute[72793]:         </nova:port>
Aug 17 04:13:42 user nova-compute[72793]:       </nova:ports>
Aug 17 04:13:42 user nova-compute[72793]:     </nova:instance>
Aug 17 04:13:42 user nova-compute[72793]:   </metadata>
Aug 17 04:13:42 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:13:42 user nova-compute[72793]:     <system>
Aug 17 04:13:42 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:13:42 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:13:42 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:13:42 user nova-compute[72793]:       <entry name="serial">3492c76f-a8cc-4db3-b2a8-6b661597d0ef</entry>
Aug 17 04:13:42 user nova-compute[72793]:       <entry name="uuid">3492c76f-a8cc-4db3-b2a8-6b661597d0ef</entry>
Aug 17 04:13:42 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:13:42 user nova-compute[72793]:     </system>
Aug 17 04:13:42 user nova-compute[72793]:   </sysinfo>
Aug 17 04:13:42 user nova-compute[72793]:   <os>
Aug 17 04:13:42 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:13:42 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:13:42 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:13:42 user nova-compute[72793]:   </os>
Aug 17 04:13:42 user nova-compute[72793]:   <features>
Aug 17 04:13:42 user nova-compute[72793]:     <acpi/>
Aug 17 04:13:42 user nova-compute[72793]:     <apic/>
Aug 17 04:13:42 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:13:42 user nova-compute[72793]:   </features>
Aug 17 04:13:42 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:13:42 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:13:42 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:13:42 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:13:42 user nova-compute[72793]:   </clock>
Aug 17 04:13:42 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:13:42 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:13:42 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:13:42 user nova-compute[72793]:   </cpu>
Aug 17 04:13:42 user nova-compute[72793]:   <devices>
Aug 17 04:13:42 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:13:42 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:13:42 user nova-compute[72793]:       <source dev="/dev/sdd"/>
Aug 17 04:13:42 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:13:42 user nova-compute[72793]:       <serial>99b584d9-49e0-4b88-b15e-3c62260abe49</serial>
Aug 17 04:13:42 user nova-compute[72793]:     </disk>
Aug 17 04:13:42 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:13:42 user nova-compute[72793]:       <mac address="fa:16:3e:6b:7a:ae"/>
Aug 17 04:13:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:13:42 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:13:42 user nova-compute[72793]:       <target dev="tapcc9ec6ec-fc"/>
Aug 17 04:13:42 user nova-compute[72793]:     </interface>
Aug 17 04:13:42 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:13:42 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/console.log" append="off"/>
Aug 17 04:13:42 user nova-compute[72793]:     </serial>
Aug 17 04:13:42 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:13:42 user nova-compute[72793]:     <video>
Aug 17 04:13:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:13:42 user nova-compute[72793]:     </video>
Aug 17 04:13:42 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:13:42 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:13:42 user nova-compute[72793]:     </rng>
Aug 17 04:13:42 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:13:42 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:13:42 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:13:42 user nova-compute[72793]:     </memballoon>
Aug 17 04:13:42 user nova-compute[72793]:   </devices>
Aug 17 04:13:42 user nova-compute[72793]: </domain>
Aug 17 04:13:42 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1716769912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1716769912',id=34,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-ka52pvdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:13:14Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=3492c76f-a8cc-4db3-b2a8-6b661597d0ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG os_vif [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc9ec6ec-fc, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc9ec6ec-fc, col_values=(('external_ids', {'iface-id': 'cc9ec6ec-fc04-4a98-a2fa-1dce988ba746', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7a:ae', 'vm-uuid': '3492c76f-a8cc-4db3-b2a8-6b661597d0ef'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:42 user nova-compute[72793]: INFO os_vif [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc')
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:13:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No VIF found with MAC fa:16:3e:6b:7a:ae, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing instance network info cache due to event network-changed-e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] Acquiring lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] Acquired lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Refreshing network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:43 user nova-compute[72793]: INFO nova.compute.manager [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Terminating instance
Aug 17 04:13:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Going to confirm migration 2 {{(pid=72793) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-686a58d9-cdea-44af-aa45-0529c209b919 req-165e3b6c-9cd0-449c-93b6-e03a395437ba service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-686a58d9-cdea-44af-aa45-0529c209b919 req-165e3b6c-9cd0-449c-93b6-e03a395437ba service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-686a58d9-cdea-44af-aa45-0529c209b919 req-165e3b6c-9cd0-449c-93b6-e03a395437ba service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-686a58d9-cdea-44af-aa45-0529c209b919 req-165e3b6c-9cd0-449c-93b6-e03a395437ba service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-686a58d9-cdea-44af-aa45-0529c209b919 req-165e3b6c-9cd0-449c-93b6-e03a395437ba service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-686a58d9-cdea-44af-aa45-0529c209b919 req-165e3b6c-9cd0-449c-93b6-e03a395437ba service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-unplugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-a00b8c5e-f7cc-4e13-a241-550309fa5620 req-6cf8fd6e-1736-48b3-ae89-8d9671af4fd1 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a00b8c5e-f7cc-4e13-a241-550309fa5620 req-6cf8fd6e-1736-48b3-ae89-8d9671af4fd1 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a00b8c5e-f7cc-4e13-a241-550309fa5620 req-6cf8fd6e-1736-48b3-ae89-8d9671af4fd1 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a00b8c5e-f7cc-4e13-a241-550309fa5620 req-6cf8fd6e-1736-48b3-ae89-8d9671af4fd1 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-a00b8c5e-f7cc-4e13-a241-550309fa5620 req-6cf8fd6e-1736-48b3-ae89-8d9671af4fd1 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:44 user nova-compute[72793]: WARNING nova.compute.manager [req-a00b8c5e-f7cc-4e13-a241-550309fa5620 req-6cf8fd6e-1736-48b3-ae89-8d9671af4fd1 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state building and task_state spawning.
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquired lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.objects.instance [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'info_cache' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updated VIF entry in instance network info cache for port e765bd5a-bdb6-4f7f-809b-fea1940e60b2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [{"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b74cc119-32cb-402b-bc7f-3c056b2a0ca3 req-bdfc985f-687e-4383-b91f-f5f3750a2e6b service nova] Releasing lock "refresh_cache-d4b8f681-6b81-49fe-8455-7564e2cafff7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Instance destroyed successfully.
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.objects.instance [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lazy-loading 'resources' on Instance uuid d4b8f681-6b81-49fe-8455-7564e2cafff7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1324529661',display_name='tempest-TestShelveInstance-server-1324529661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1324529661',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7rbX5FWzGJLg513BkMi0YLwoKTiCYhJOfOK/vSJVxmqVMLntYShoqpiiRRc9m3dLTzcAmIs0KxJOn9BEPcB8Sh6+usS+R6zQjnt1PTMzrkGIXUUFgbEV5jR5m9Z+LRZg==',key_name='tempest-TestShelveInstance-567723049',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29f31f57bb7f4b90b0f9d018a662c6e1',ramdisk_id='',reservation_id='r-jb4ngety',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-278994045',owner_user_name='tempest-TestShelveInstance-278994045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:12:14Z,user_data=None,user_id='ddc21d6c97ef4b4a982b4011e9ebd13b',uuid=d4b8f681-6b81-49fe-8455-7564e2cafff7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converting VIF {"id": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "address": "fa:16:3e:e7:cb:49", "network": {"id": "d87c6665-b323-428d-ad72-78694fec1f07", "bridge": "br-int", "label": "tempest-TestShelveInstance-1324931891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f31f57bb7f4b90b0f9d018a662c6e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape765bd5a-bd", "ovs_interfaceid": "e765bd5a-bdb6-4f7f-809b-fea1940e60b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_vif [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape765bd5a-bd, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:44 user nova-compute[72793]: INFO os_vif [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:cb:49,bridge_name='br-int',has_traffic_filtering=True,id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2,network=Network(d87c6665-b323-428d-ad72-78694fec1f07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape765bd5a-bd')
Aug 17 04:13:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JnHkowIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:13:44 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78be23-1519-4eb2-8b4e-cedeebc367bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b17526-be2c-47ec-9c0a-bfbaf85afb01]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:13:44 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:13:44 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:13:44 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:13:44 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:13:44 user nova-compute[72793]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced (non-flash)
Aug 17 04:13:44 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:13:44 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:13:44 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acf163b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d911bca-f364-4a3d-be9c-4fb4955eb2ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d7927-ddec-4471-8731-563b930853cd]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9974be47-2e69-4e79-9f1b-0afa988b6213]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:13:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb6fbe5-73c8-4804-9f75-7fb77873b19c]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [{"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2767e06b-1f12-48c0-8d96-2623d8a99686]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Releasing lock "refresh_cache-758b73d6-9b4c-46cc-be56-a17f56709cf4" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'migration_context' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[02885f3b-e042-4a51-9dfe-9b56f03f281b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260]
Aug 17 04:13:45 user nova-compute[72793]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced, portal: 172.16.0.220,3260] successful.
Aug 17 04:13:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3917248-1333-4826-b941-b7e0ab0c5ced -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0c3632-2756-4a1b-bf6a-6bfcd96b4623]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] <== disconnect_volume: return (316ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:13:45 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Deleting instance files /opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7_del
Aug 17 04:13:45 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Deletion of /opt/stack/data/nova/instances/d4b8f681-6b81-49fe-8455-7564e2cafff7_del complete
Aug 17 04:13:45 user nova-compute[72793]: INFO nova.compute.manager [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.505s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:45 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Deleted allocation for migration 3ad4a698-6952-43aa-8352-d532881632f7
Aug 17 04:13:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-10c4b80f-0aeb-41b9-9f6c-c0b7a491e427 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.922s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:45 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Took 0.66 seconds to deallocate network for instance.
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-67967597-0289-45d8-ad4d-2e8466832594 req-8008e780-8639-4764-a89e-15cec8eb380c service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-deleted-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:45 user nova-compute[72793]: INFO nova.compute.manager [req-67967597-0289-45d8-ad4d-2e8466832594 req-8008e780-8639-4764-a89e-15cec8eb380c service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Neutron deleted interface e765bd5a-bdb6-4f7f-809b-fea1940e60b2; detaching it from the instance and deleting it from the info cache
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-67967597-0289-45d8-ad4d-2e8466832594 req-8008e780-8639-4764-a89e-15cec8eb380c service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-67967597-0289-45d8-ad4d-2e8466832594 req-8008e780-8639-4764-a89e-15cec8eb380c service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Detach interface failed, port_id=e765bd5a-bdb6-4f7f-809b-fea1940e60b2, reason: Instance d4b8f681-6b81-49fe-8455-7564e2cafff7 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-06b9102b-3e61-4bec-b01a-54143454044f req-45d5717b-6d1f-485f-bfea-12f9ad848b5d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-06b9102b-3e61-4bec-b01a-54143454044f req-45d5717b-6d1f-485f-bfea-12f9ad848b5d service nova] Acquiring lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-06b9102b-3e61-4bec-b01a-54143454044f req-45d5717b-6d1f-485f-bfea-12f9ad848b5d service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-06b9102b-3e61-4bec-b01a-54143454044f req-45d5717b-6d1f-485f-bfea-12f9ad848b5d service nova] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-06b9102b-3e61-4bec-b01a-54143454044f req-45d5717b-6d1f-485f-bfea-12f9ad848b5d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] No waiting events found dispatching network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:46 user nova-compute[72793]: WARNING nova.compute.manager [req-06b9102b-3e61-4bec-b01a-54143454044f req-45d5717b-6d1f-485f-bfea-12f9ad848b5d service nova] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Received unexpected event network-vif-plugged-e765bd5a-bdb6-4f7f-809b-fea1940e60b2 for instance with vm_state active and task_state deleting.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-4456a4f7-4901-4149-83b4-623194f713a4 req-33c9c94a-d51d-43e9-92fc-f6d264145faa service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4456a4f7-4901-4149-83b4-623194f713a4 req-33c9c94a-d51d-43e9-92fc-f6d264145faa service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4456a4f7-4901-4149-83b4-623194f713a4 req-33c9c94a-d51d-43e9-92fc-f6d264145faa service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4456a4f7-4901-4149-83b4-623194f713a4 req-33c9c94a-d51d-43e9-92fc-f6d264145faa service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-4456a4f7-4901-4149-83b4-623194f713a4 req-33c9c94a-d51d-43e9-92fc-f6d264145faa service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:13:46 user nova-compute[72793]: WARNING nova.compute.manager [req-4456a4f7-4901-4149-83b4-623194f713a4 req-33c9c94a-d51d-43e9-92fc-f6d264145faa service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state building and task_state spawning.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245626.6185179, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Resumed (Lifecycle Event)
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance spawned successfully.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245626.6196826, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Started (Lifecycle Event)
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Deleting volume: b3917248-1333-4826-b941-b7e0ab0c5ced {{(pid=72793) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:46 user nova-compute[72793]: INFO nova.compute.manager [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Took 33.40 seconds to build instance.
Aug 17 04:13:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3c332e01-972f-4458-98ea-70ac6dbdba0d tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.508s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:47 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:47 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:47 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Deleted allocations for instance d4b8f681-6b81-49fe-8455-7564e2cafff7
Aug 17 04:13:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0f176eef-ca0d-4d6e-a3d7-40c94c618806 tempest-TestShelveInstance-278994045 tempest-TestShelveInstance-278994045-project-member] Lock "d4b8f681-6b81-49fe-8455-7564e2cafff7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.354s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 210d0b74-53d8-45d4-b4b4-691c18fc125b {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid ef52ab14-abca-42c8-8266-204444ede656 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "d3b38fd0-f823-4a39-927a-52c064339731" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "ef52ab14-abca-42c8-8266-204444ede656" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "d3b38fd0-f823-4a39-927a-52c064339731" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "ef52ab14-abca-42c8-8266-204444ede656" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:13:56 user nova-compute[72793]: INFO nova.compute.claims [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Claim successful on node user
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:13:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:13:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.policy [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cbad450f600b4d0aac294be4cd145fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba66a3ba645414983fd9fa888e734c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:13:57 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Creating image(s)
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.213s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk 1073741824" returned: 0 in 0.052s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Successfully created port: c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Cannot resize image /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.objects.instance [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'migration_context' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Ensure instance console log exists: /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:13:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Successfully updated port: c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing instance network info cache due to event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:13:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.neutron [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance network_info: |[{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.neutron [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Start _get_guest_xml network_info=[{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:13:59 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:13:59 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271896945',display_name='tempest-ServerRescueNegativeTestJSON-server-271896945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271896945',id=35,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiLjDybp3SvYmN4ApaLN5ioF/eAWa6/TR6dUNnPRndQ43CBfOx0HSmh12VLhFv1WfC5t9zurBh+QaEf7xccvL4nsh9PozlS2vnzP4tWnSFinoQGQVCUZ/Nhnyoqg8mLvg==',key_name='tempest-keypair-1142879458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-n0ekpjwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=dae77365-0f83-4512-ac59-c2ca7c692feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.objects.instance [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'pci_devices' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:13:59 user nova-compute[72793]:   <uuid>dae77365-0f83-4512-ac59-c2ca7c692feb</uuid>
Aug 17 04:13:59 user nova-compute[72793]:   <name>instance-00000023</name>
Aug 17 04:13:59 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:13:59 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:13:59 user nova-compute[72793]:   <metadata>
Aug 17 04:13:59 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:13:59 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:13:59 user nova-compute[72793]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-271896945</nova:name>
Aug 17 04:13:59 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:13:59</nova:creationTime>
Aug 17 04:13:59 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:13:59 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:13:59 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:13:59 user nova-compute[72793]:       <nova:owner>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:user uuid="cbad450f600b4d0aac294be4cd145fa5">tempest-ServerRescueNegativeTestJSON-1617582959-project-member</nova:user>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:project uuid="fba66a3ba645414983fd9fa888e734c9">tempest-ServerRescueNegativeTestJSON-1617582959</nova:project>
Aug 17 04:13:59 user nova-compute[72793]:       </nova:owner>
Aug 17 04:13:59 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:13:59 user nova-compute[72793]:       <nova:ports>
Aug 17 04:13:59 user nova-compute[72793]:         <nova:port uuid="c588567c-caae-4c85-ad06-93a5e0d96cc2">
Aug 17 04:13:59 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:13:59 user nova-compute[72793]:         </nova:port>
Aug 17 04:13:59 user nova-compute[72793]:       </nova:ports>
Aug 17 04:13:59 user nova-compute[72793]:     </nova:instance>
Aug 17 04:13:59 user nova-compute[72793]:   </metadata>
Aug 17 04:13:59 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:13:59 user nova-compute[72793]:     <system>
Aug 17 04:13:59 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:13:59 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:13:59 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:13:59 user nova-compute[72793]:       <entry name="serial">dae77365-0f83-4512-ac59-c2ca7c692feb</entry>
Aug 17 04:13:59 user nova-compute[72793]:       <entry name="uuid">dae77365-0f83-4512-ac59-c2ca7c692feb</entry>
Aug 17 04:13:59 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:13:59 user nova-compute[72793]:     </system>
Aug 17 04:13:59 user nova-compute[72793]:   </sysinfo>
Aug 17 04:13:59 user nova-compute[72793]:   <os>
Aug 17 04:13:59 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:13:59 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:13:59 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:13:59 user nova-compute[72793]:   </os>
Aug 17 04:13:59 user nova-compute[72793]:   <features>
Aug 17 04:13:59 user nova-compute[72793]:     <acpi/>
Aug 17 04:13:59 user nova-compute[72793]:     <apic/>
Aug 17 04:13:59 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:13:59 user nova-compute[72793]:   </features>
Aug 17 04:13:59 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:13:59 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:13:59 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:13:59 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:13:59 user nova-compute[72793]:   </clock>
Aug 17 04:13:59 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:13:59 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:13:59 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:13:59 user nova-compute[72793]:   </cpu>
Aug 17 04:13:59 user nova-compute[72793]:   <devices>
Aug 17 04:13:59 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:13:59 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:13:59 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk"/>
Aug 17 04:13:59 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:13:59 user nova-compute[72793]:     </disk>
Aug 17 04:13:59 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:13:59 user nova-compute[72793]:       <mac address="fa:16:3e:01:4b:3f"/>
Aug 17 04:13:59 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:13:59 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:13:59 user nova-compute[72793]:       <target dev="tapc588567c-ca"/>
Aug 17 04:13:59 user nova-compute[72793]:     </interface>
Aug 17 04:13:59 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:13:59 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/console.log" append="off"/>
Aug 17 04:13:59 user nova-compute[72793]:     </serial>
Aug 17 04:13:59 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:13:59 user nova-compute[72793]:     <video>
Aug 17 04:13:59 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:13:59 user nova-compute[72793]:     </video>
Aug 17 04:13:59 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:13:59 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:13:59 user nova-compute[72793]:     </rng>
Aug 17 04:13:59 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:13:59 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:13:59 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:13:59 user nova-compute[72793]:     </memballoon>
Aug 17 04:13:59 user nova-compute[72793]:   </devices>
Aug 17 04:13:59 user nova-compute[72793]: </domain>
Aug 17 04:13:59 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271896945',display_name='tempest-ServerRescueNegativeTestJSON-server-271896945',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271896945',id=35,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiLjDybp3SvYmN4ApaLN5ioF/eAWa6/TR6dUNnPRndQ43CBfOx0HSmh12VLhFv1WfC5t9zurBh+QaEf7xccvL4nsh9PozlS2vnzP4tWnSFinoQGQVCUZ/Nhnyoqg8mLvg==',key_name='tempest-keypair-1142879458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-n0ekpjwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=dae77365-0f83-4512-ac59-c2ca7c692feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG os_vif [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc588567c-ca, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc588567c-ca, col_values=(('external_ids', {'iface-id': 'c588567c-caae-4c85-ad06-93a5e0d96cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:4b:3f', 'vm-uuid': 'dae77365-0f83-4512-ac59-c2ca7c692feb'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:13:59 user nova-compute[72793]: INFO os_vif [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca')
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:01:4b:3f, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.neutron [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updated VIF entry in instance network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.network.neutron [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aaf3d74e-1370-48b3-a473-74a880c80559 req-111736b1-741d-4942-9791-362432c7a95b service nova] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245624.7636619, d4b8f681-6b81-49fe-8455-7564e2cafff7 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:13:59 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] VM Stopped (Lifecycle Event)
Aug 17 04:13:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-d22d7870-e36a-4a70-84f9-4fa9c283534a None None] [instance: d4b8f681-6b81-49fe-8455-7564e2cafff7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-d4645cc0-dc05-4440-ad94-cca20644ba5a req-dec6872a-9229-4afa-8e79-36c5d5c40c6c service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:14:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4645cc0-dc05-4440-ad94-cca20644ba5a req-dec6872a-9229-4afa-8e79-36c5d5c40c6c service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4645cc0-dc05-4440-ad94-cca20644ba5a req-dec6872a-9229-4afa-8e79-36c5d5c40c6c service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4645cc0-dc05-4440-ad94-cca20644ba5a req-dec6872a-9229-4afa-8e79-36c5d5c40c6c service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-d4645cc0-dc05-4440-ad94-cca20644ba5a req-dec6872a-9229-4afa-8e79-36c5d5c40c6c service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:14:01 user nova-compute[72793]: WARNING nova.compute.manager [req-d4645cc0-dc05-4440-ad94-cca20644ba5a req-dec6872a-9229-4afa-8e79-36c5d5c40c6c service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state building and task_state spawning.
Aug 17 04:14:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245642.8801887, dae77365-0f83-4512-ac59-c2ca7c692feb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:14:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Resumed (Lifecycle Event)
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:14:02 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance spawned successfully.
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245642.8823864, dae77365-0f83-4512-ac59-c2ca7c692feb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:14:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Started (Lifecycle Event)
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:14:02 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:14:02 user nova-compute[72793]: INFO nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 17 04:14:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-5bc7ce28-d89e-48b0-a31c-32f5686550e0 req-0d005d16-1719-4595-b15d-eb1e5bcb7d7d service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:14:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5bc7ce28-d89e-48b0-a31c-32f5686550e0 req-0d005d16-1719-4595-b15d-eb1e5bcb7d7d service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5bc7ce28-d89e-48b0-a31c-32f5686550e0 req-0d005d16-1719-4595-b15d-eb1e5bcb7d7d service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5bc7ce28-d89e-48b0-a31c-32f5686550e0 req-0d005d16-1719-4595-b15d-eb1e5bcb7d7d service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-5bc7ce28-d89e-48b0-a31c-32f5686550e0 req-0d005d16-1719-4595-b15d-eb1e5bcb7d7d service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:14:03 user nova-compute[72793]: WARNING nova.compute.manager [req-5bc7ce28-d89e-48b0-a31c-32f5686550e0 req-0d005d16-1719-4595-b15d-eb1e5bcb7d7d service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state building and task_state spawning.
Aug 17 04:14:03 user nova-compute[72793]: INFO nova.compute.manager [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Took 6.61 seconds to build instance.
Aug 17 04:14:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-5d80fd16-f69b-443a-b258-679840670f6f tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.712s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-changed-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Refreshing instance network info cache due to event network-changed-4823d2d4-0910-44e5-921b-e81019dede34. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] Acquiring lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] Acquired lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Refreshing network info cache for port 4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updated VIF entry in instance network info cache for port 4823d2d4-0910-44e5-921b-e81019dede34. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updating instance_info_cache with network_info: [{"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0196cbbb-52b5-4186-84d8-f060581bffa3 req-55441485-faf0-44e0-a31d-7da2313f77ea service nova] Releasing lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG nova.objects.instance [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'flavor' on Instance uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:10 user nova-compute[72793]: INFO nova.compute.manager [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Attaching volume aba10175-6d43-4bf8-a226-3835dc708320 to /dev/vdb
Aug 17 04:14:10 user nova-compute[72793]: DEBUG os_brick.utils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[250eb464-4d7a-42f2-9827-d4873ac0a604]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed31ead4-da0c-4f05-82de-478b46f30589]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[472083ec-7ccc-497e-b022-ae20e16e84b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaaddf9-cc78-4505-a763-350e9e04554e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:14:10 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:14:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[78adb648-4a7d-4c6f-975c-0336c7db9482]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG os_brick.utils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updating existing volume attachment record: 0196b74b-8041-4e1f-9732-e84c80c18b63 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:14:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:14:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:14:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7227MB free_disk=25.230777740478516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:14:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:14:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:14:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:14:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:14:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updating instance_info_cache with network_info: [{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:14:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdbuMotE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:14:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:14:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:14:25 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a9434a-42e5-4134-9252-1a0f1ed9ed92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:14:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb68b5b-14c5-474b-99ae-29deabd524d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320] added
Aug 17 04:14:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bd4137-c31f-4fbe-8cd9-def7ea8a2a6a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbc9360-f899-44bd-82fc-079b74e00e81]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdbuMotE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdbuMotE" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed8531-945a-47ea-837b-cafadb99bd89]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mdbuMotE'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe3070-eb53-4ac9-87c0-aea5f8eb4fd1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc9a33-26a9-43b7-8bc3-ef3ed8cb91d9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc42de-7475-439e-8414-a819e6542f44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260]
Aug 17 04:14:25 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260] successful.
Aug 17 04:14:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60cce95-da5f-460c-aea8-c4b6fc6223c1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb761f3-c960-41b4-9942-4a2e2099c033]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 (non-flash)
Aug 17 04:14:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc4f5d1-9014-4059-ae46-f2090504f6c4]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdbuMotE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:14:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:14:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23034313764396364', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:14:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313764396364', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:14:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'flavor' on Instance uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:14:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:14:26 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:14:26 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:14:26 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:14:26 user nova-compute[72793]:   <serial>aba10175-6d43-4bf8-a226-3835dc708320</serial>
Aug 17 04:14:26 user nova-compute[72793]: </disk>
Aug 17 04:14:26 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:14:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:14:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:14:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No VIF found with MAC fa:16:3e:cd:92:33, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:14:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-30585799-8542-49ff-ab81-02c5ce033f04 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.965s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:29 user nova-compute[72793]: INFO nova.compute.manager [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Detaching volume aba10175-6d43-4bf8-a226-3835dc708320
Aug 17 04:14:29 user nova-compute[72793]: INFO nova.virt.block_device [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Attempting to driver detach volume aba10175-6d43-4bf8-a226-3835dc708320 from mountpoint /dev/vdb
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Attempting to detach device vdb from instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:14:29 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:14:29 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:14:29 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:14:29 user nova-compute[72793]:   <serial>aba10175-6d43-4bf8-a226-3835dc708320</serial>
Aug 17 04:14:29 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:14:29 user nova-compute[72793]: </disk>
Aug 17 04:14:29 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:14:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully detached device vdb from instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 from the persistent domain config.
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:14:29 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:14:29 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:14:29 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:14:29 user nova-compute[72793]:   <serial>aba10175-6d43-4bf8-a226-3835dc708320</serial>
Aug 17 04:14:29 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:14:29 user nova-compute[72793]: </disk>
Aug 17 04:14:29 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245669.658173, 5324b34b-1ce3-41c7-b3f3-47156e936a33 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:14:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully detached device vdb from instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 from the live domain config.
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdbuMotE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:14:29 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eced883a-30ee-4802-985c-4e56380a4a83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c0fd42-9c32-4e34-a098-37c59cae582a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:14:29 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:14:29 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:14:29 user nova-compute[72793]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 (non-flash)
Aug 17 04:14:29 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:14:29 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:14:29 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:14:29 user nova-compute[72793]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 (non-flash)
Aug 17 04:14:29 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d013bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a2871a-97d1-4175-a2d5-ace639b2e250]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5496127f-9179-48f3-9654-577ea96754dc]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9904b4d9-bc11-4454-93db-81d9529d550c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfab741-cfa3-4628-95d6-309906eb4c35]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f40f07f-bda4-4e7d-8a05-215dca9bc4c9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0077e887-7439-4afa-947d-23432f4a53be]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260]
Aug 17 04:14:29 user nova-compute[72793]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320, portal: 172.16.0.220,3260] successful.
Aug 17 04:14:29 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aba10175-6d43-4bf8-a226-3835dc708320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c619fd4-f792-4397-9d84-a03cddc9cfad]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] <== disconnect_volume: return (287ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:14:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:14:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'flavor' on Instance uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:14:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b663fe48-77cb-4ac2-95ca-7ea353aef481 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "47728048-3982-4001-b08e-43c6bd06f7bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:14:31 user nova-compute[72793]: INFO nova.compute.claims [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Claim successful on node user
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:14:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.policy [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad60fa5186024d2e8c03a99d8b90834a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ff1feab57f4390be7855b073d7c634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:14:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Creating image(s)
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "/opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "/opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "/opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk 1073741824" returned: 0 in 0.072s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Successfully created port: aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Cannot resize image /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lazy-loading 'migration_context' on Instance uuid 47728048-3982-4001-b08e-43c6bd06f7bb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Ensure instance console log exists: /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Successfully updated port: aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "refresh_cache-47728048-3982-4001-b08e-43c6bd06f7bb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquired lock "refresh_cache-47728048-3982-4001-b08e-43c6bd06f7bb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-changed-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Refreshing instance network info cache due to event network-changed-aa74582f-cda3-4b47-b753-e7b03d05345e. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] Acquiring lock "refresh_cache-47728048-3982-4001-b08e-43c6bd06f7bb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Updating instance_info_cache with network_info: [{"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Releasing lock "refresh_cache-47728048-3982-4001-b08e-43c6bd06f7bb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Instance network_info: |[{"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] Acquired lock "refresh_cache-47728048-3982-4001-b08e-43c6bd06f7bb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.neutron [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Refreshing network info cache for port aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Start _get_guest_xml network_info=[{"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:14:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:14:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1065658462',display_name='tempest-ServersNegativeTestJSON-server-1065658462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1065658462',id=36,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ff1feab57f4390be7855b073d7c634',ramdisk_id='',reservation_id='r-ga07ttd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-698989669',owner_user_name='tempest-ServersNegativeTestJSON-698989669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:14:32Z,user_data=None,user_id='ad60fa5186024d2e8c03a99d8b90834a',uuid=47728048-3982-4001-b08e-43c6bd06f7bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converting VIF {"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lazy-loading 'pci_devices' on Instance uuid 47728048-3982-4001-b08e-43c6bd06f7bb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:14:33 user nova-compute[72793]:   <uuid>47728048-3982-4001-b08e-43c6bd06f7bb</uuid>
Aug 17 04:14:33 user nova-compute[72793]:   <name>instance-00000024</name>
Aug 17 04:14:33 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:14:33 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:14:33 user nova-compute[72793]:   <metadata>
Aug 17 04:14:33 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:14:33 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:14:33 user nova-compute[72793]:       <nova:name>tempest-ServersNegativeTestJSON-server-1065658462</nova:name>
Aug 17 04:14:33 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:14:33</nova:creationTime>
Aug 17 04:14:33 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:14:33 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:14:33 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:14:33 user nova-compute[72793]:       <nova:owner>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:user uuid="ad60fa5186024d2e8c03a99d8b90834a">tempest-ServersNegativeTestJSON-698989669-project-member</nova:user>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:project uuid="13ff1feab57f4390be7855b073d7c634">tempest-ServersNegativeTestJSON-698989669</nova:project>
Aug 17 04:14:33 user nova-compute[72793]:       </nova:owner>
Aug 17 04:14:33 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:14:33 user nova-compute[72793]:       <nova:ports>
Aug 17 04:14:33 user nova-compute[72793]:         <nova:port uuid="aa74582f-cda3-4b47-b753-e7b03d05345e">
Aug 17 04:14:33 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 04:14:33 user nova-compute[72793]:         </nova:port>
Aug 17 04:14:33 user nova-compute[72793]:       </nova:ports>
Aug 17 04:14:33 user nova-compute[72793]:     </nova:instance>
Aug 17 04:14:33 user nova-compute[72793]:   </metadata>
Aug 17 04:14:33 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:14:33 user nova-compute[72793]:     <system>
Aug 17 04:14:33 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:14:33 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:14:33 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:14:33 user nova-compute[72793]:       <entry name="serial">47728048-3982-4001-b08e-43c6bd06f7bb</entry>
Aug 17 04:14:33 user nova-compute[72793]:       <entry name="uuid">47728048-3982-4001-b08e-43c6bd06f7bb</entry>
Aug 17 04:14:33 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:14:33 user nova-compute[72793]:     </system>
Aug 17 04:14:33 user nova-compute[72793]:   </sysinfo>
Aug 17 04:14:33 user nova-compute[72793]:   <os>
Aug 17 04:14:33 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:14:33 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:14:33 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:14:33 user nova-compute[72793]:   </os>
Aug 17 04:14:33 user nova-compute[72793]:   <features>
Aug 17 04:14:33 user nova-compute[72793]:     <acpi/>
Aug 17 04:14:33 user nova-compute[72793]:     <apic/>
Aug 17 04:14:33 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:14:33 user nova-compute[72793]:   </features>
Aug 17 04:14:33 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:14:33 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:14:33 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:14:33 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:14:33 user nova-compute[72793]:   </clock>
Aug 17 04:14:33 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:14:33 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:14:33 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:14:33 user nova-compute[72793]:   </cpu>
Aug 17 04:14:33 user nova-compute[72793]:   <devices>
Aug 17 04:14:33 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:14:33 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:14:33 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk"/>
Aug 17 04:14:33 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:14:33 user nova-compute[72793]:     </disk>
Aug 17 04:14:33 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:14:33 user nova-compute[72793]:       <mac address="fa:16:3e:60:ab:ce"/>
Aug 17 04:14:33 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:14:33 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:14:33 user nova-compute[72793]:       <target dev="tapaa74582f-cd"/>
Aug 17 04:14:33 user nova-compute[72793]:     </interface>
Aug 17 04:14:33 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:14:33 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/console.log" append="off"/>
Aug 17 04:14:33 user nova-compute[72793]:     </serial>
Aug 17 04:14:33 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:14:33 user nova-compute[72793]:     <video>
Aug 17 04:14:33 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:14:33 user nova-compute[72793]:     </video>
Aug 17 04:14:33 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:14:33 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:14:33 user nova-compute[72793]:     </rng>
Aug 17 04:14:33 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:14:33 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:14:33 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:14:33 user nova-compute[72793]:     </memballoon>
Aug 17 04:14:33 user nova-compute[72793]:   </devices>
Aug 17 04:14:33 user nova-compute[72793]: </domain>
Aug 17 04:14:33 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1065658462',display_name='tempest-ServersNegativeTestJSON-server-1065658462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1065658462',id=36,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ff1feab57f4390be7855b073d7c634',ramdisk_id='',reservation_id='r-ga07ttd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-698989669',owner_user_name='tempest-ServersNegativeTestJSON-698989669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:14:32Z,user_data=None,user_id='ad60fa5186024d2e8c03a99d8b90834a',uuid=47728048-3982-4001-b08e-43c6bd06f7bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converting VIF {"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG os_vif [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa74582f-cd, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa74582f-cd, col_values=(('external_ids', {'iface-id': 'aa74582f-cda3-4b47-b753-e7b03d05345e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:ab:ce', 'vm-uuid': '47728048-3982-4001-b08e-43c6bd06f7bb'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:33 user nova-compute[72793]: INFO os_vif [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd')
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:14:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] No VIF found with MAC fa:16:3e:60:ab:ce, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:14:34 user nova-compute[72793]: DEBUG nova.network.neutron [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Updated VIF entry in instance network info cache for port aa74582f-cda3-4b47-b753-e7b03d05345e. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:14:34 user nova-compute[72793]: DEBUG nova.network.neutron [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Updating instance_info_cache with network_info: [{"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:14:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6b9b0afc-139c-4813-955a-98cf661ac4e7 req-a502559f-c55c-49da-a3fc-11d174b425ab service nova] Releasing lock "refresh_cache-47728048-3982-4001-b08e-43c6bd06f7bb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-fde8c50e-22c7-4e52-a511-9cf2f42616b1 req-71c24737-d863-4064-b3e8-94a5b2eb2adf service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fde8c50e-22c7-4e52-a511-9cf2f42616b1 req-71c24737-d863-4064-b3e8-94a5b2eb2adf service nova] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fde8c50e-22c7-4e52-a511-9cf2f42616b1 req-71c24737-d863-4064-b3e8-94a5b2eb2adf service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fde8c50e-22c7-4e52-a511-9cf2f42616b1 req-71c24737-d863-4064-b3e8-94a5b2eb2adf service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-fde8c50e-22c7-4e52-a511-9cf2f42616b1 req-71c24737-d863-4064-b3e8-94a5b2eb2adf service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] No waiting events found dispatching network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:14:35 user nova-compute[72793]: WARNING nova.compute.manager [req-fde8c50e-22c7-4e52-a511-9cf2f42616b1 req-71c24737-d863-4064-b3e8-94a5b2eb2adf service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received unexpected event network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e for instance with vm_state building and task_state spawning.
Aug 17 04:14:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-3ca3c246-167f-4068-826c-d56c257bf2da req-e288f6c7-9cfb-4ce5-85aa-3f830f1faf4f service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3ca3c246-167f-4068-826c-d56c257bf2da req-e288f6c7-9cfb-4ce5-85aa-3f830f1faf4f service nova] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3ca3c246-167f-4068-826c-d56c257bf2da req-e288f6c7-9cfb-4ce5-85aa-3f830f1faf4f service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3ca3c246-167f-4068-826c-d56c257bf2da req-e288f6c7-9cfb-4ce5-85aa-3f830f1faf4f service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-3ca3c246-167f-4068-826c-d56c257bf2da req-e288f6c7-9cfb-4ce5-85aa-3f830f1faf4f service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] No waiting events found dispatching network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:14:37 user nova-compute[72793]: WARNING nova.compute.manager [req-3ca3c246-167f-4068-826c-d56c257bf2da req-e288f6c7-9cfb-4ce5-85aa-3f830f1faf4f service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received unexpected event network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e for instance with vm_state building and task_state spawning.
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245677.688643, 47728048-3982-4001-b08e-43c6bd06f7bb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] VM Resumed (Lifecycle Event)
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Instance spawned successfully.
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245677.6898491, 47728048-3982-4001-b08e-43c6bd06f7bb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] VM Started (Lifecycle Event)
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 17 04:14:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:14:37 user nova-compute[72793]: INFO nova.compute.manager [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Took 6.76 seconds to build instance.
Aug 17 04:14:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e6f41a19-4d3f-4573-a1e5-b4bc3b0fdc48 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "47728048-3982-4001-b08e-43c6bd06f7bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.858s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:14:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:14:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:14:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:14:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:14:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:14:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:14:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:14:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:14:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:14:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:14:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:14:59 user nova-compute[72793]: INFO nova.compute.manager [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Unshelving
Aug 17 04:15:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'pci_requests' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:15:00 user nova-compute[72793]: INFO nova.compute.claims [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Claim successful on node user
Aug 17 04:15:00 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:00 user nova-compute[72793]: INFO nova.network.neutron [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating port d9fdf7ae-ef51-4807-b307-ab01e770070b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing instance network info cache due to event network-changed-d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] Acquiring lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:15:01 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Creating image(s)
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] Acquired lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG nova.network.neutron [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Refreshing network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "61704a03535e68382bf4d2fb9b5209afe072677e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "61704a03535e68382bf4d2fb9b5209afe072677e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.part --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG nova.virt.images [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] 1df8469a-92a0-4dd0-b110-ada46ecd3f04 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.part /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updated VIF entry in instance network info cache for port d9fdf7ae-ef51-4807-b307-ab01e770070b. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dde8d6bd-53a3-441c-a4b7-1c9c8636b88c req-103138b7-144f-4a36-b129-db65fdad25ca service nova] Releasing lock "refresh_cache-8ffa2387-a317-4b02-90be-797d8de5c6b9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.part /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.converted" returned: 0 in 0.574s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "61704a03535e68382bf4d2fb9b5209afe072677e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.135s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "61704a03535e68382bf4d2fb9b5209afe072677e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "61704a03535e68382bf4d2fb9b5209afe072677e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:04 user nova-compute[72793]: INFO nova.compute.manager [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Rescuing
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e,backing_fmt=raw /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e,backing_fmt=raw /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk 1073741824" returned: 0 in 0.051s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "61704a03535e68382bf4d2fb9b5209afe072677e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'migration_context' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Rebasing disk image.
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Updating instance_info_cache with network_info: [{"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d -F raw /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-d9a64cc0-ff59-4c5e-8e34-eab5625d096b req-d71fce99-91a4-40a0-a5ee-ac6fbbeeeea7 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d9a64cc0-ff59-4c5e-8e34-eab5625d096b req-d71fce99-91a4-40a0-a5ee-ac6fbbeeeea7 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d9a64cc0-ff59-4c5e-8e34-eab5625d096b req-d71fce99-91a4-40a0-a5ee-ac6fbbeeeea7 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d9a64cc0-ff59-4c5e-8e34-eab5625d096b req-d71fce99-91a4-40a0-a5ee-ac6fbbeeeea7 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-d9a64cc0-ff59-4c5e-8e34-eab5625d096b req-d71fce99-91a4-40a0-a5ee-ac6fbbeeeea7 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:05 user nova-compute[72793]: WARNING nova.compute.manager [req-d9a64cc0-ff59-4c5e-8e34-eab5625d096b req-d71fce99-91a4-40a0-a5ee-ac6fbbeeeea7 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance destroyed successfully.
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Attempting a stable device rescue
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72793) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:15:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Creating image(s)
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "/opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "/opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.compute.manager [req-ea675e73-29e4-47e4-a2c7-14239ed9e835 req-73fbc3b4-2a20-4577-b388-0091b50a3775 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d -F raw /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk" returned: 0 in 2.547s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Ensure instance console log exists: /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Start _get_guest_xml network_info=[{"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0560b0d7344c9fc6700ef89b60e3070f',container_format='bare',created_at=2023-08-17T04:13:07Z,direct_url=<?>,disk_format='qcow2',id=1df8469a-92a0-4dd0-b110-ada46ecd3f04,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-362401097-shelved',owner='f916dfd267de46389faa83f4947db86f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T04:13:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:07 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0560b0d7344c9fc6700ef89b60e3070f',container_format='bare',created_at=2023-08-17T04:13:07Z,direct_url=<?>,disk_format='qcow2',id=1df8469a-92a0-4dd0-b110-ada46ecd3f04,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-362401097-shelved',owner='f916dfd267de46389faa83f4947db86f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T04:13:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-362401097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-362401097',id=31,image_ref='1df8469a-92a0-4dd0-b110-ada46ecd3f04',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1719939993',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-k8m4wj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member',shelved_at='2023-08-17T04:13:11.307764',shelved_host='user',shelved_image_id='1df8469a-92a0-4dd0-b110-ada46ecd3f04'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=8ffa2387-a317-4b02-90be-797d8de5c6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:15:07 user nova-compute[72793]:   <uuid>8ffa2387-a317-4b02-90be-797d8de5c6b9</uuid>
Aug 17 04:15:07 user nova-compute[72793]:   <name>instance-0000001f</name>
Aug 17 04:15:07 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:15:07 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:15:07 user nova-compute[72793]:   <metadata>
Aug 17 04:15:07 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:15:07 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:15:07 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-362401097</nova:name>
Aug 17 04:15:07 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:15:07</nova:creationTime>
Aug 17 04:15:07 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:15:07 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:15:07 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:15:07 user nova-compute[72793]:       <nova:owner>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:user uuid="e1420f8967734176ac04ac8b1e2646ea">tempest-AttachVolumeShelveTestJSON-266550928-project-member</nova:user>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:project uuid="f916dfd267de46389faa83f4947db86f">tempest-AttachVolumeShelveTestJSON-266550928</nova:project>
Aug 17 04:15:07 user nova-compute[72793]:       </nova:owner>
Aug 17 04:15:07 user nova-compute[72793]:       <nova:root type="image" uuid="1df8469a-92a0-4dd0-b110-ada46ecd3f04"/>
Aug 17 04:15:07 user nova-compute[72793]:       <nova:ports>
Aug 17 04:15:07 user nova-compute[72793]:         <nova:port uuid="d9fdf7ae-ef51-4807-b307-ab01e770070b">
Aug 17 04:15:07 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:15:07 user nova-compute[72793]:         </nova:port>
Aug 17 04:15:07 user nova-compute[72793]:       </nova:ports>
Aug 17 04:15:07 user nova-compute[72793]:     </nova:instance>
Aug 17 04:15:07 user nova-compute[72793]:   </metadata>
Aug 17 04:15:07 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:15:07 user nova-compute[72793]:     <system>
Aug 17 04:15:07 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:15:07 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:15:07 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:15:07 user nova-compute[72793]:       <entry name="serial">8ffa2387-a317-4b02-90be-797d8de5c6b9</entry>
Aug 17 04:15:07 user nova-compute[72793]:       <entry name="uuid">8ffa2387-a317-4b02-90be-797d8de5c6b9</entry>
Aug 17 04:15:07 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:15:07 user nova-compute[72793]:     </system>
Aug 17 04:15:07 user nova-compute[72793]:   </sysinfo>
Aug 17 04:15:07 user nova-compute[72793]:   <os>
Aug 17 04:15:07 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:15:07 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:15:07 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:15:07 user nova-compute[72793]:   </os>
Aug 17 04:15:07 user nova-compute[72793]:   <features>
Aug 17 04:15:07 user nova-compute[72793]:     <acpi/>
Aug 17 04:15:07 user nova-compute[72793]:     <apic/>
Aug 17 04:15:07 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:15:07 user nova-compute[72793]:   </features>
Aug 17 04:15:07 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:15:07 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:15:07 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:15:07 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:15:07 user nova-compute[72793]:   </clock>
Aug 17 04:15:07 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:15:07 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:15:07 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:15:07 user nova-compute[72793]:   </cpu>
Aug 17 04:15:07 user nova-compute[72793]:   <devices>
Aug 17 04:15:07 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:15:07 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:15:07 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk"/>
Aug 17 04:15:07 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:15:07 user nova-compute[72793]:     </disk>
Aug 17 04:15:07 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:15:07 user nova-compute[72793]:       <mac address="fa:16:3e:d6:04:ee"/>
Aug 17 04:15:07 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:15:07 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:15:07 user nova-compute[72793]:       <target dev="tapd9fdf7ae-ef"/>
Aug 17 04:15:07 user nova-compute[72793]:     </interface>
Aug 17 04:15:07 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:15:07 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/console.log" append="off"/>
Aug 17 04:15:07 user nova-compute[72793]:     </serial>
Aug 17 04:15:07 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:15:07 user nova-compute[72793]:     <video>
Aug 17 04:15:07 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:15:07 user nova-compute[72793]:     </video>
Aug 17 04:15:07 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:15:07 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:15:07 user nova-compute[72793]:     </rng>
Aug 17 04:15:07 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:15:07 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:15:07 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:15:07 user nova-compute[72793]:     </memballoon>
Aug 17 04:15:07 user nova-compute[72793]:   </devices>
Aug 17 04:15:07 user nova-compute[72793]: </domain>
Aug 17 04:15:07 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-362401097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-362401097',id=31,image_ref='1df8469a-92a0-4dd0-b110-ada46ecd3f04',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1719939993',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-k8m4wj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member',shelved_at='2023-08-17T04:13:11.307764',shelved_host='user',shelved_image_id='1df8469a-92a0-4dd0-b110-ada46ecd3f04'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=8ffa2387-a317-4b02-90be-797d8de5c6b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG os_vif [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9fdf7ae-ef, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9fdf7ae-ef, col_values=(('external_ids', {'iface-id': 'd9fdf7ae-ef51-4807-b307-ab01e770070b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:04:ee', 'vm-uuid': '8ffa2387-a317-4b02-90be-797d8de5c6b9'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.part --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.images [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] d88a8e36-c9b7-478d-8bb1-0dc0a99e4841 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.part /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:07 user nova-compute[72793]: INFO os_vif [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef')
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] No VIF found with MAC fa:16:3e:d6:04:ee, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.part /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.converted" returned: 0 in 0.262s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.139s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a,backing_fmt=raw /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a,backing_fmt=raw /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue" returned: 0 in 0.060s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'migration_context' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Start _get_guest_xml network_info=[{"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "vif_mac": "fa:16:3e:6b:7a:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd88a8e36-c9b7-478d-8bb1-0dc0a99e4841', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3492c76f-a8cc-4db3-b2a8-6b661597d0ef', 'attached_at': '', 'detached_at': '', 'volume_id': '99b584d9-49e0-4b88-b15e-3c62260abe49', 'serial': '99b584d9-49e0-4b88-b15e-3c62260abe49'}, 'guest_format': None, 'attachment_id': 'abe3b402-8b09-4782-9af0-d079a22487cb', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'resources' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'numa_topology' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:08 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:08 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:15:08 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:15:08 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:15:08 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf3957-5b59-4129-859d-7903d0523854]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NrURuXpe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 04:15:08 user nova-compute[72793]: node.name = iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49
Aug 17 04:15:08 user nova-compute[72793]: node.tpgt = -1
Aug 17 04:15:08 user nova-compute[72793]: node.startup = automatic
Aug 17 04:15:08 user nova-compute[72793]: node.leading_login = No
Aug 17 04:15:08 user nova-compute[72793]: iface.iscsi_ifacename = default
Aug 17 04:15:08 user nova-compute[72793]: iface.net_ifacename = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.ipaddress = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.prefix_len = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.hwaddress = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.transport_name = tcp
Aug 17 04:15:08 user nova-compute[72793]: iface.initiatorname = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.vlan_id = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.vlan_priority = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.vlan_state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.iface_num = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.mtu = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.port = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.bootproto = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.subnet_mask = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.gateway = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_alt_client_id = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_dns = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_learn_iqn = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_vendor_id_state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_vendor_id = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.dhcp_slp_da = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.fragmentation = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.gratuitous_arp = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.incoming_forwarding = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.tos_state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.tos = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.ttl = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.delayed_ack = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.tcp_nagle = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.tcp_wsf_state = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.tcp_wsf = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.tcp_timer_scale = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.tcp_timestamp = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.redirect = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.def_task_mgmt_timeout = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.header_digest = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.data_digest = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.immediate_data = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.initial_r2t = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.data_seq_inorder = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.data_pdu_inorder = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.erl = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.max_receive_data_len = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.first_burst_len = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.max_outstanding_r2t = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.max_burst_len = 0
Aug 17 04:15:08 user nova-compute[72793]: iface.chap_auth = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.bidi_chap = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.strict_login_compliance = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.discovery_auth = <empty>
Aug 17 04:15:08 user nova-compute[72793]: iface.discovery_logout = <empty>
Aug 17 04:15:08 user nova-compute[72793]: node.discovery_address = <empty>
Aug 17 04:15:08 user nova-compute[72793]: node.discovery_port = 0
Aug 17 04:15:08 user nova-compute[72793]: node.discovery_type = static
Aug 17 04:15:08 user nova-compute[72793]: node.session.initial_cmdsn = 0
Aug 17 04:15:08 user nova-compute[72793]: node.session.initial_login_retry_max = 8
Aug 17 04:15:08 user nova-compute[72793]: node.session.xmit_thread_priority = -20
Aug 17 04:15:08 user nova-compute[72793]: node.session.cmds_max = 128
Aug 17 04:15:08 user nova-compute[72793]: node.session.queue_depth = 32
Aug 17 04:15:08 user nova-compute[72793]: node.session.nr_sessions = 1
Aug 17 04:15:08 user nova-compute[72793]: node.session.auth.authmethod = CHAP
Aug 17 04:15:08 user nova-compute[72793]: node.session.auth.username = NrURuXpe
Aug 17 04:15:08 user nova-compute[72793]: node.session.auth.password = ***
Aug 17 04:15:08 user nova-compute[72793]: node.session.auth.username_in = <empty>
Aug 17 04:15:08 user nova-compute[72793]: node.session.auth.password_in = <empty>
Aug 17 04:15:08 user nova-compute[72793]: node.session.auth.chap_algs = MD5
Aug 17 04:15:08 user nova-compute[72793]: node.session.timeo.replacement_timeout = 120
Aug 17 04:15:08 user nova-compute[72793]: node.session.err_timeo.abort_timeout = 15
Aug 17 04:15:08 user nova-compute[72793]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 04:15:08 user nova-compute[72793]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 04:15:08 user nova-compute[72793]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.FastAbort = Yes
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.InitialR2T = No
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.ImmediateData = Yes
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.MaxConnections = 1
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 04:15:08 user nova-compute[72793]: node.session.iscsi.ERL = 0
Aug 17 04:15:08 user nova-compute[72793]: node.session.scan = manual
Aug 17 04:15:08 user nova-compute[72793]: node.session.reopen_max = 0
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].address = 172.16.0.220
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].port = 3260
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].startup = manual
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].tcp.window_size = 524288
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].tcp.type_of_service = 0
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].timeo.logout_timeout = 15
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].timeo.login_timeout = 15
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].timeo.auth_timeout = 45
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].iscsi.DataDigest = None
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].iscsi.IFMarker = No
Aug 17 04:15:08 user nova-compute[72793]: node.conn[0].iscsi.OFMarker = No
Aug 17 04:15:08 user nova-compute[72793]: # END RECORD
Aug 17 04:15:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[11911128-a63a-4154-bd03-ae25994fabd0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[803ba88a-9bd1-4a3e-aff6-51ea91893039]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrURuXpe {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrURuXpe" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d63416-8298-41ae-92f6-9912c3fc41bc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NrURuXpe'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c831d46c-b79f-4915-bc03-d3ae99b8e9ae]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad2af07-ac5e-43d4-90c4-527638fac561]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:15:08 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:15:08 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:15:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:15:08 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:15:08 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:15:08 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.137s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] HCTL ('35', '0', '0', 0) found on session 39 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0415d-d11d-4274-9c5d-add39f1e8b27]: (4, ('0 0 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Searching for a device in session 39 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== connect_volume: return (163ms) {'type': 'block', 'scsi_wwn': '26231346334383866', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231346334383866', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1716769912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1716769912',id=34,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-ka52pvdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:13:47Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=3492c76f-a8cc-4db3-b2a8-6b661597d0ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "vif_mac": "fa:16:3e:6b:7a:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "vif_mac": "fa:16:3e:6b:7a:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'pci_devices' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:15:08 user nova-compute[72793]:   <uuid>3492c76f-a8cc-4db3-b2a8-6b661597d0ef</uuid>
Aug 17 04:15:08 user nova-compute[72793]:   <name>instance-00000022</name>
Aug 17 04:15:08 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:15:08 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:15:08 user nova-compute[72793]:   <metadata>
Aug 17 04:15:08 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:15:08 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:15:08 user nova-compute[72793]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1716769912</nova:name>
Aug 17 04:15:08 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:15:08</nova:creationTime>
Aug 17 04:15:08 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:15:08 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:15:08 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:15:08 user nova-compute[72793]:       <nova:owner>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:user uuid="21663e2118004c528a64a7fba2e29ee3">tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member</nova:user>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:project uuid="a1ec39bbf61f45c6963f018159dcb33c">tempest-ServerBootFromVolumeStableRescueTest-1752371327</nova:project>
Aug 17 04:15:08 user nova-compute[72793]:       </nova:owner>
Aug 17 04:15:08 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:15:08 user nova-compute[72793]:       <nova:ports>
Aug 17 04:15:08 user nova-compute[72793]:         <nova:port uuid="cc9ec6ec-fc04-4a98-a2fa-1dce988ba746">
Aug 17 04:15:08 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 04:15:08 user nova-compute[72793]:         </nova:port>
Aug 17 04:15:08 user nova-compute[72793]:       </nova:ports>
Aug 17 04:15:08 user nova-compute[72793]:     </nova:instance>
Aug 17 04:15:08 user nova-compute[72793]:   </metadata>
Aug 17 04:15:08 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:15:08 user nova-compute[72793]:     <system>
Aug 17 04:15:08 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:15:08 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:15:08 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:15:08 user nova-compute[72793]:       <entry name="serial">3492c76f-a8cc-4db3-b2a8-6b661597d0ef</entry>
Aug 17 04:15:08 user nova-compute[72793]:       <entry name="uuid">3492c76f-a8cc-4db3-b2a8-6b661597d0ef</entry>
Aug 17 04:15:08 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:15:08 user nova-compute[72793]:     </system>
Aug 17 04:15:08 user nova-compute[72793]:   </sysinfo>
Aug 17 04:15:08 user nova-compute[72793]:   <os>
Aug 17 04:15:08 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:15:08 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:15:08 user nova-compute[72793]:   </os>
Aug 17 04:15:08 user nova-compute[72793]:   <features>
Aug 17 04:15:08 user nova-compute[72793]:     <acpi/>
Aug 17 04:15:08 user nova-compute[72793]:     <apic/>
Aug 17 04:15:08 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:15:08 user nova-compute[72793]:   </features>
Aug 17 04:15:08 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:15:08 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:15:08 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:15:08 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:15:08 user nova-compute[72793]:   </clock>
Aug 17 04:15:08 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:15:08 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:15:08 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:15:08 user nova-compute[72793]:   </cpu>
Aug 17 04:15:08 user nova-compute[72793]:   <devices>
Aug 17 04:15:08 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:15:08 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:15:08 user nova-compute[72793]:       <source dev="/dev/sdd"/>
Aug 17 04:15:08 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:15:08 user nova-compute[72793]:       <serial>99b584d9-49e0-4b88-b15e-3c62260abe49</serial>
Aug 17 04:15:08 user nova-compute[72793]:     </disk>
Aug 17 04:15:08 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:15:08 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:15:08 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue"/>
Aug 17 04:15:08 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:15:08 user nova-compute[72793]:       <boot order="1"/>
Aug 17 04:15:08 user nova-compute[72793]:     </disk>
Aug 17 04:15:08 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:15:08 user nova-compute[72793]:       <mac address="fa:16:3e:6b:7a:ae"/>
Aug 17 04:15:08 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:15:08 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:15:08 user nova-compute[72793]:       <target dev="tapcc9ec6ec-fc"/>
Aug 17 04:15:08 user nova-compute[72793]:     </interface>
Aug 17 04:15:08 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:15:08 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/console.log" append="off"/>
Aug 17 04:15:08 user nova-compute[72793]:     </serial>
Aug 17 04:15:08 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:15:08 user nova-compute[72793]:     <video>
Aug 17 04:15:08 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:15:08 user nova-compute[72793]:     </video>
Aug 17 04:15:08 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:15:08 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:15:08 user nova-compute[72793]:     </rng>
Aug 17 04:15:08 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:15:08 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:15:08 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:15:08 user nova-compute[72793]:     </memballoon>
Aug 17 04:15:08 user nova-compute[72793]:   </devices>
Aug 17 04:15:08 user nova-compute[72793]: </domain>
Aug 17 04:15:08 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:15:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance destroyed successfully.
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:15:08 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] No VIF found with MAC fa:16:3e:6b:7a:ae, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-5c97616e-4f5c-4fb0-b2a5-3945844acd77 req-4006f335-6d36-49c6-84ec-046bd8de6dfb service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5c97616e-4f5c-4fb0-b2a5-3945844acd77 req-4006f335-6d36-49c6-84ec-046bd8de6dfb service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5c97616e-4f5c-4fb0-b2a5-3945844acd77 req-4006f335-6d36-49c6-84ec-046bd8de6dfb service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5c97616e-4f5c-4fb0-b2a5-3945844acd77 req-4006f335-6d36-49c6-84ec-046bd8de6dfb service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-5c97616e-4f5c-4fb0-b2a5-3945844acd77 req-4006f335-6d36-49c6-84ec-046bd8de6dfb service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:09 user nova-compute[72793]: WARNING nova.compute.manager [req-5c97616e-4f5c-4fb0-b2a5-3945844acd77 req-4006f335-6d36-49c6-84ec-046bd8de6dfb service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:11 user nova-compute[72793]: WARNING nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 04:15:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:11 user nova-compute[72793]: WARNING nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:11 user nova-compute[72793]: WARNING nova.compute.manager [req-ddb17006-e1b5-4edf-bf93-1d6e45fe342e req-fb64b95c-072f-4fb3-b273-13c880d05f5b service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state rescuing.
Aug 17 04:15:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:12 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for 3492c76f-a8cc-4db3-b2a8-6b661597d0ef due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245713.084468, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Resumed (Lifecycle Event)
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3b27e095-aa50-44c7-9f3c-813e6e1bf13c tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance spawned successfully.
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245713.088399, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Started (Lifecycle Event)
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245713.1288626, 8ffa2387-a317-4b02-90be-797d8de5c6b9 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] VM Resumed (Lifecycle Event)
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245713.1293612, 8ffa2387-a317-4b02-90be-797d8de5c6b9 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] VM Started (Lifecycle Event)
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:15:13 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:15:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6fa2931f-de92-4470-92b4-f6ad098ac0db tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.501s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:15:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:15:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7378MB free_disk=25.042747497558594GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 47728048-3982-4001-b08e-43c6bd06f7bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ffa2387-a317-4b02-90be-797d8de5c6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:15:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:15:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:15:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:15:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:15:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:15:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:15:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:15:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:28 user nova-compute[72793]: INFO nova.compute.manager [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] instance snapshotting
Aug 17 04:15:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Beginning live snapshot process
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json -f qcow2 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcsj0qicy/9997c61be98e4d45bb81d56107693da9.delta 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcsj0qicy/9997c61be98e4d45bb81d56107693da9.delta 1073741824" returned: 0 in 0.061s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 04:15:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:15:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72793) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 04:15:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 04:15:30 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:15:30 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcsj0qicy/9997c61be98e4d45bb81d56107693da9.delta /opt/stack/data/nova/instances/snapshots/tmpcsj0qicy/9997c61be98e4d45bb81d56107693da9 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcsj0qicy/9997c61be98e4d45bb81d56107693da9.delta /opt/stack/data/nova/instances/snapshots/tmpcsj0qicy/9997c61be98e4d45bb81d56107693da9" returned: 0 in 0.465s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Snapshot extracted, beginning image upload
Aug 17 04:15:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Snapshot image upload complete
Aug 17 04:15:33 user nova-compute[72793]: INFO nova.compute.manager [None req-1410056f-d2a9-467e-88c3-6700dfdd44af tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Took 4.92 seconds to snapshot the instance on the hypervisor.
Aug 17 04:15:35 user nova-compute[72793]: INFO nova.compute.manager [None req-2c241c41-3d9c-41e6-a401-69b4a35a9f83 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Get console output
Aug 17 04:15:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:15:35 user nova-compute[72793]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 04:15:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:35 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:15:35 user nova-compute[72793]: INFO nova.compute.claims [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Claim successful on node user
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.network.neutron [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:15:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.policy [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec6ad70b73a9436387c6d5812b30d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d5df793fe4f43b6aa166ea78757d6c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:15:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Creating image(s)
Aug 17 04:15:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "/opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "/opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "/opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "1b44d1d23b38484cc92e788defddd3fe2009bff3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "1b44d1d23b38484cc92e788defddd3fe2009bff3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.part --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG nova.network.neutron [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Successfully created port: 888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.part --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG nova.virt.images [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] bf3e75e2-c3d5-4563-8ceb-e6a6ff383808 was qcow2, converting to raw {{(pid=72793) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG nova.privsep.utils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72793) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 04:15:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.part /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.converted {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.part /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.converted" returned: 0 in 0.343s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.converted --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "1b44d1d23b38484cc92e788defddd3fe2009bff3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.860s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Successfully updated port: 888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquired lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "1b44d1d23b38484cc92e788defddd3fe2009bff3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "1b44d1d23b38484cc92e788defddd3fe2009bff3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-changed-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Refreshing instance network info cache due to event network-changed-888c087b-6b68-4e2b-b054-cbd8fff1a96a. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] Acquiring lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 --force-share --output=json" returned: 0 in 0.254s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3,backing_fmt=raw /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3,backing_fmt=raw /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk 1073741824" returned: 0 in 0.080s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "1b44d1d23b38484cc92e788defddd3fe2009bff3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.neutron [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updating instance_info_cache with network_info: [{"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Releasing lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Instance network_info: |[{"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] Acquired lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.neutron [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Refreshing network info cache for port 888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.objects.instance [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'migration_context' on Instance uuid 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Ensure instance console log exists: /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Start _get_guest_xml network_info=[{"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c3ca73d78a67e1b80aba8f593b628948',container_format='bare',created_at=2023-08-17T04:15:29Z,direct_url=<?>,disk_format='qcow2',id=bf3e75e2-c3d5-4563-8ceb-e6a6ff383808,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-743026521',owner='6d5df793fe4f43b6aa166ea78757d6c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T04:15:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': 'bf3e75e2-c3d5-4563-8ceb-e6a6ff383808'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:15:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c3ca73d78a67e1b80aba8f593b628948',container_format='bare',created_at=2023-08-17T04:15:29Z,direct_url=<?>,disk_format='qcow2',id=bf3e75e2-c3d5-4563-8ceb-e6a6ff383808,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-743026521',owner='6d5df793fe4f43b6aa166ea78757d6c5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T04:15:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1202399895',display_name='tempest-TestStampPattern-server-1202399895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1202399895',id=37,image_ref='bf3e75e2-c3d5-4563-8ceb-e6a6ff383808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqB9t/3sSVxFk9/g96xP3rSFx0LEd2VPNOmRyPR0ztCb9JD+Im4SIlqAcSlRg4TJTgiGLSOyiJ+Bqo6d7fO59SFjP1HSGL8I2vjXUN6yYYLnoGGfgGlKAbcF/3Sh8woWw==',key_name='tempest-TestStampPattern-408149894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5df793fe4f43b6aa166ea78757d6c5',ramdisk_id='',reservation_id='r-sjcisnfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5324b34b-1ce3-41c7-b3f3-47156e936a33',image_min_disk='1',image_min_ram='0',image_owner_id='6d5df793fe4f43b6aa166ea78757d6c5',image_owner_project_name='tempest-TestStampPattern-174584011',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-174584011-project-member',image_user_id='ec6ad70b73a9436387c6d5812b30d1f5',network_allocated='True',owner_project_name='tempest-TestStampPattern-174584011',owner_user_name='tempest-TestStampPattern-174584011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:15:37Z,user_data=None,user_id='ec6ad70b73a9436387c6d5812b30d1f5',uuid=103e1896-9e0f-4533-9c10-a9eb2dca5012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converting VIF {"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.objects.instance [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'pci_devices' on Instance uuid 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:15:39 user nova-compute[72793]:   <uuid>103e1896-9e0f-4533-9c10-a9eb2dca5012</uuid>
Aug 17 04:15:39 user nova-compute[72793]:   <name>instance-00000025</name>
Aug 17 04:15:39 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:15:39 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:15:39 user nova-compute[72793]:   <metadata>
Aug 17 04:15:39 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:15:39 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:15:39 user nova-compute[72793]:       <nova:name>tempest-TestStampPattern-server-1202399895</nova:name>
Aug 17 04:15:39 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:15:39</nova:creationTime>
Aug 17 04:15:39 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:15:39 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:15:39 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:15:39 user nova-compute[72793]:       <nova:owner>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:user uuid="ec6ad70b73a9436387c6d5812b30d1f5">tempest-TestStampPattern-174584011-project-member</nova:user>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:project uuid="6d5df793fe4f43b6aa166ea78757d6c5">tempest-TestStampPattern-174584011</nova:project>
Aug 17 04:15:39 user nova-compute[72793]:       </nova:owner>
Aug 17 04:15:39 user nova-compute[72793]:       <nova:root type="image" uuid="bf3e75e2-c3d5-4563-8ceb-e6a6ff383808"/>
Aug 17 04:15:39 user nova-compute[72793]:       <nova:ports>
Aug 17 04:15:39 user nova-compute[72793]:         <nova:port uuid="888c087b-6b68-4e2b-b054-cbd8fff1a96a">
Aug 17 04:15:39 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 04:15:39 user nova-compute[72793]:         </nova:port>
Aug 17 04:15:39 user nova-compute[72793]:       </nova:ports>
Aug 17 04:15:39 user nova-compute[72793]:     </nova:instance>
Aug 17 04:15:39 user nova-compute[72793]:   </metadata>
Aug 17 04:15:39 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:15:39 user nova-compute[72793]:     <system>
Aug 17 04:15:39 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:15:39 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:15:39 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:15:39 user nova-compute[72793]:       <entry name="serial">103e1896-9e0f-4533-9c10-a9eb2dca5012</entry>
Aug 17 04:15:39 user nova-compute[72793]:       <entry name="uuid">103e1896-9e0f-4533-9c10-a9eb2dca5012</entry>
Aug 17 04:15:39 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:15:39 user nova-compute[72793]:     </system>
Aug 17 04:15:39 user nova-compute[72793]:   </sysinfo>
Aug 17 04:15:39 user nova-compute[72793]:   <os>
Aug 17 04:15:39 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:15:39 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:15:39 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:15:39 user nova-compute[72793]:   </os>
Aug 17 04:15:39 user nova-compute[72793]:   <features>
Aug 17 04:15:39 user nova-compute[72793]:     <acpi/>
Aug 17 04:15:39 user nova-compute[72793]:     <apic/>
Aug 17 04:15:39 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:15:39 user nova-compute[72793]:   </features>
Aug 17 04:15:39 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:15:39 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:15:39 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:15:39 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:15:39 user nova-compute[72793]:   </clock>
Aug 17 04:15:39 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:15:39 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:15:39 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:15:39 user nova-compute[72793]:   </cpu>
Aug 17 04:15:39 user nova-compute[72793]:   <devices>
Aug 17 04:15:39 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:15:39 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:15:39 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk"/>
Aug 17 04:15:39 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:15:39 user nova-compute[72793]:     </disk>
Aug 17 04:15:39 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:15:39 user nova-compute[72793]:       <mac address="fa:16:3e:a2:9e:50"/>
Aug 17 04:15:39 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:15:39 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:15:39 user nova-compute[72793]:       <target dev="tap888c087b-6b"/>
Aug 17 04:15:39 user nova-compute[72793]:     </interface>
Aug 17 04:15:39 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:15:39 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/console.log" append="off"/>
Aug 17 04:15:39 user nova-compute[72793]:     </serial>
Aug 17 04:15:39 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:15:39 user nova-compute[72793]:     <video>
Aug 17 04:15:39 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:15:39 user nova-compute[72793]:     </video>
Aug 17 04:15:39 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:15:39 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:15:39 user nova-compute[72793]:     </rng>
Aug 17 04:15:39 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:15:39 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:15:39 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:15:39 user nova-compute[72793]:     </memballoon>
Aug 17 04:15:39 user nova-compute[72793]:   </devices>
Aug 17 04:15:39 user nova-compute[72793]: </domain>
Aug 17 04:15:39 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1202399895',display_name='tempest-TestStampPattern-server-1202399895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1202399895',id=37,image_ref='bf3e75e2-c3d5-4563-8ceb-e6a6ff383808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqB9t/3sSVxFk9/g96xP3rSFx0LEd2VPNOmRyPR0ztCb9JD+Im4SIlqAcSlRg4TJTgiGLSOyiJ+Bqo6d7fO59SFjP1HSGL8I2vjXUN6yYYLnoGGfgGlKAbcF/3Sh8woWw==',key_name='tempest-TestStampPattern-408149894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d5df793fe4f43b6aa166ea78757d6c5',ramdisk_id='',reservation_id='r-sjcisnfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5324b34b-1ce3-41c7-b3f3-47156e936a33',image_min_disk='1',image_min_ram='0',image_owner_id='6d5df793fe4f43b6aa166ea78757d6c5',image_owner_project_name='tempest-TestStampPattern-174584011',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-174584011-project-member',image_user_id='ec6ad70b73a9436387c6d5812b30d1f5',network_allocated='True',owner_project_name='tempest-TestStampPattern-174584011',owner_user_name='tempest-TestStampPattern-174584011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:15:37Z,user_data=None,user_id='ec6ad70b73a9436387c6d5812b30d1f5',uuid=103e1896-9e0f-4533-9c10-a9eb2dca5012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converting VIF {"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG os_vif [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap888c087b-6b, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap888c087b-6b, col_values=(('external_ids', {'iface-id': '888c087b-6b68-4e2b-b054-cbd8fff1a96a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:9e:50', 'vm-uuid': '103e1896-9e0f-4533-9c10-a9eb2dca5012'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:39 user nova-compute[72793]: INFO os_vif [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b')
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No VIF found with MAC fa:16:3e:a2:9e:50, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.neutron [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updated VIF entry in instance network info cache for port 888c087b-6b68-4e2b-b054-cbd8fff1a96a. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG nova.network.neutron [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updating instance_info_cache with network_info: [{"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:15:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0f73da87-0c3e-4e6f-a387-149a657eb430 req-44de9346-edae-46b3-b343-ae7799d8e618 service nova] Releasing lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:15:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-97899b3a-dd32-4029-9f38-50dabf40a40b req-ef783aa4-acae-4b25-8390-24c86b7c485e service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-97899b3a-dd32-4029-9f38-50dabf40a40b req-ef783aa4-acae-4b25-8390-24c86b7c485e service nova] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-97899b3a-dd32-4029-9f38-50dabf40a40b req-ef783aa4-acae-4b25-8390-24c86b7c485e service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-97899b3a-dd32-4029-9f38-50dabf40a40b req-ef783aa4-acae-4b25-8390-24c86b7c485e service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-97899b3a-dd32-4029-9f38-50dabf40a40b req-ef783aa4-acae-4b25-8390-24c86b7c485e service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] No waiting events found dispatching network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:41 user nova-compute[72793]: WARNING nova.compute.manager [req-97899b3a-dd32-4029-9f38-50dabf40a40b req-ef783aa4-acae-4b25-8390-24c86b7c485e service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received unexpected event network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a for instance with vm_state building and task_state spawning.
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245743.0726938, 103e1896-9e0f-4533-9c10-a9eb2dca5012 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] VM Resumed (Lifecycle Event)
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Instance spawned successfully.
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-cbbeccf9-d3c2-4529-af00-18b309edaf7d req-551052e1-6b94-47ea-a347-8cac879ff792 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cbbeccf9-d3c2-4529-af00-18b309edaf7d req-551052e1-6b94-47ea-a347-8cac879ff792 service nova] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cbbeccf9-d3c2-4529-af00-18b309edaf7d req-551052e1-6b94-47ea-a347-8cac879ff792 service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cbbeccf9-d3c2-4529-af00-18b309edaf7d req-551052e1-6b94-47ea-a347-8cac879ff792 service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-cbbeccf9-d3c2-4529-af00-18b309edaf7d req-551052e1-6b94-47ea-a347-8cac879ff792 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] No waiting events found dispatching network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:15:43 user nova-compute[72793]: WARNING nova.compute.manager [req-cbbeccf9-d3c2-4529-af00-18b309edaf7d req-551052e1-6b94-47ea-a347-8cac879ff792 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received unexpected event network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a for instance with vm_state building and task_state spawning.
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245743.0733535, 103e1896-9e0f-4533-9c10-a9eb2dca5012 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] VM Started (Lifecycle Event)
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Took 6.63 seconds to spawn the instance on the hypervisor.
Aug 17 04:15:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:15:43 user nova-compute[72793]: INFO nova.compute.manager [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Took 7.66 seconds to build instance.
Aug 17 04:15:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0366ef7b-96a3-4a05-9de4-3b450dda5034 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.783s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:15:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing instance network info cache due to event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:15:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:15:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:15:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updated VIF entry in instance network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-67f1d406-6a82-4f40-99a6-49a0fc6d44d0 req-2c12d95b-f77c-42a4-b01d-3379a360206b service nova] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'flavor' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:15:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:15:49 user nova-compute[72793]: INFO nova.compute.manager [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Attaching volume 3af25ad6-8bce-482a-b735-4298515edfc1 to /dev/vdb
Aug 17 04:15:49 user nova-compute[72793]: DEBUG os_brick.utils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576e529-a52f-4610-81f8-3e36171eda2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7131da-7b2c-4126-be96-c1608f284d70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f8e13-43c1-4443-b8ac-3340c5cebdb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c7b98-dfce-422e-800d-04bac13c5f40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:15:49 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:15:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[391badae-5095-4976-83c7-72e16d8b0162]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG os_brick.utils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating existing volume attachment record: 654840a9-ac21-4914-9d1b-50e371f40dcc {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:15:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:15:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZFeORW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:16:03 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:16:03 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:16:03 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d8e5c1-c369-4dc7-92f3-531006768898]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:16:03 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb1d437-de94-4351-bb57-bca990ec2e9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1] added
Aug 17 04:16:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0d4f77-704e-49fa-b8d2-6d437b7f5864]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc70597d-b608-4a6d-9662-ae3a0d1043c1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViZFeORW {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViZFeORW" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9232abd5-a405-4bf9-aa53-5c36dd86a136]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ViZFeORW'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362bbf6-516d-4d09-8e2b-5ce2629833e7]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a3981-1e0d-4ed1-a31f-0a4936744410]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a08da9-1298-4066-8b50-c37df819306c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260]
Aug 17 04:16:03 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260] successful.
Aug 17 04:16:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[682187ef-b623-448d-b319-47b3f4b691cf]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1c6a9b-b57b-4755-805e-3fbd3dfc9b5b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:16:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b0685e-3213-47a1-bf4e-3b104207d0b0]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZFeORW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23565663866366465', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565663866366465', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'flavor' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:16:04 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:16:04 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:16:04 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:16:04 user nova-compute[72793]:   <serial>3af25ad6-8bce-482a-b735-4298515edfc1</serial>
Aug 17 04:16:04 user nova-compute[72793]: </disk>
Aug 17 04:16:04 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:16:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:01:4b:3f, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:16:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873cd0f5-af0a-4f80-aced-ba04da27f7ba tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.023s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:05 user nova-compute[72793]: INFO nova.compute.manager [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Rescuing
Aug 17 04:16:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:16:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:16:05 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:16:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG nova.network.neutron [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-7714abfa-bcf3-47d6-a93b-b4ecd5ca9860 req-d896e43f-76b7-4c47-ab90-996b097a07e0 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7714abfa-bcf3-47d6-a93b-b4ecd5ca9860 req-d896e43f-76b7-4c47-ab90-996b097a07e0 service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7714abfa-bcf3-47d6-a93b-b4ecd5ca9860 req-d896e43f-76b7-4c47-ab90-996b097a07e0 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7714abfa-bcf3-47d6-a93b-b4ecd5ca9860 req-d896e43f-76b7-4c47-ab90-996b097a07e0 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-7714abfa-bcf3-47d6-a93b-b4ecd5ca9860 req-d896e43f-76b7-4c47-ab90-996b097a07e0 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:06 user nova-compute[72793]: WARNING nova.compute.manager [req-7714abfa-bcf3-47d6-a93b-b4ecd5ca9860 req-d896e43f-76b7-4c47-ab90-996b097a07e0 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state active and task_state rescuing.
Aug 17 04:16:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance destroyed successfully.
Aug 17 04:16:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Attempting rescue
Aug 17 04:16:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72793) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance directory exists: not creating {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 04:16:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Creating image(s)
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'trusted_certs' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue" returned: 0 in 0.054s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'migration_context' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Start _get_guest_xml network_info=[{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:01:4b:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'resources' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'numa_topology' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:07 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:16:07 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'vcpu_model' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271896945',display_name='tempest-ServerRescueNegativeTestJSON-server-271896945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271896945',id=35,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiLjDybp3SvYmN4ApaLN5ioF/eAWa6/TR6dUNnPRndQ43CBfOx0HSmh12VLhFv1WfC5t9zurBh+QaEf7xccvL4nsh9PozlS2vnzP4tWnSFinoQGQVCUZ/Nhnyoqg8mLvg==',key_name='tempest-keypair-1142879458',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-n0ekpjwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=dae77365-0f83-4512-ac59-c2ca7c692feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:01:4b:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "vif_mac": "fa:16:3e:01:4b:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'pci_devices' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:16:07 user nova-compute[72793]:   <uuid>dae77365-0f83-4512-ac59-c2ca7c692feb</uuid>
Aug 17 04:16:07 user nova-compute[72793]:   <name>instance-00000023</name>
Aug 17 04:16:07 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:16:07 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:16:07 user nova-compute[72793]:   <metadata>
Aug 17 04:16:07 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:16:07 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:16:07 user nova-compute[72793]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-271896945</nova:name>
Aug 17 04:16:07 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:16:07</nova:creationTime>
Aug 17 04:16:07 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:16:07 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:16:07 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:16:07 user nova-compute[72793]:       <nova:owner>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:user uuid="cbad450f600b4d0aac294be4cd145fa5">tempest-ServerRescueNegativeTestJSON-1617582959-project-member</nova:user>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:project uuid="fba66a3ba645414983fd9fa888e734c9">tempest-ServerRescueNegativeTestJSON-1617582959</nova:project>
Aug 17 04:16:07 user nova-compute[72793]:       </nova:owner>
Aug 17 04:16:07 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:16:07 user nova-compute[72793]:       <nova:ports>
Aug 17 04:16:07 user nova-compute[72793]:         <nova:port uuid="c588567c-caae-4c85-ad06-93a5e0d96cc2">
Aug 17 04:16:07 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:16:07 user nova-compute[72793]:         </nova:port>
Aug 17 04:16:07 user nova-compute[72793]:       </nova:ports>
Aug 17 04:16:07 user nova-compute[72793]:     </nova:instance>
Aug 17 04:16:07 user nova-compute[72793]:   </metadata>
Aug 17 04:16:07 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:16:07 user nova-compute[72793]:     <system>
Aug 17 04:16:07 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:16:07 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:16:07 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:16:07 user nova-compute[72793]:       <entry name="serial">dae77365-0f83-4512-ac59-c2ca7c692feb</entry>
Aug 17 04:16:07 user nova-compute[72793]:       <entry name="uuid">dae77365-0f83-4512-ac59-c2ca7c692feb</entry>
Aug 17 04:16:07 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:16:07 user nova-compute[72793]:     </system>
Aug 17 04:16:07 user nova-compute[72793]:   </sysinfo>
Aug 17 04:16:07 user nova-compute[72793]:   <os>
Aug 17 04:16:07 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:16:07 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:16:07 user nova-compute[72793]:   </os>
Aug 17 04:16:07 user nova-compute[72793]:   <features>
Aug 17 04:16:07 user nova-compute[72793]:     <acpi/>
Aug 17 04:16:07 user nova-compute[72793]:     <apic/>
Aug 17 04:16:07 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:16:07 user nova-compute[72793]:   </features>
Aug 17 04:16:07 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:16:07 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:16:07 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:16:07 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:16:07 user nova-compute[72793]:   </clock>
Aug 17 04:16:07 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:16:07 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:16:07 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:16:07 user nova-compute[72793]:   </cpu>
Aug 17 04:16:07 user nova-compute[72793]:   <devices>
Aug 17 04:16:07 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:16:07 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:16:07 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue"/>
Aug 17 04:16:07 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:16:07 user nova-compute[72793]:     </disk>
Aug 17 04:16:07 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:16:07 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:16:07 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk"/>
Aug 17 04:16:07 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:16:07 user nova-compute[72793]:     </disk>
Aug 17 04:16:07 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:16:07 user nova-compute[72793]:       <mac address="fa:16:3e:01:4b:3f"/>
Aug 17 04:16:07 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:16:07 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:16:07 user nova-compute[72793]:       <target dev="tapc588567c-ca"/>
Aug 17 04:16:07 user nova-compute[72793]:     </interface>
Aug 17 04:16:07 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:16:07 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/console.log" append="off"/>
Aug 17 04:16:07 user nova-compute[72793]:     </serial>
Aug 17 04:16:07 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:16:07 user nova-compute[72793]:     <video>
Aug 17 04:16:07 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:16:07 user nova-compute[72793]:     </video>
Aug 17 04:16:07 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:16:07 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:16:07 user nova-compute[72793]:     </rng>
Aug 17 04:16:07 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:16:07 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:16:07 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:16:07 user nova-compute[72793]:     </memballoon>
Aug 17 04:16:07 user nova-compute[72793]:   </devices>
Aug 17 04:16:07 user nova-compute[72793]: </domain>
Aug 17 04:16:07 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:16:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance destroyed successfully.
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:16:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] No VIF found with MAC fa:16:3e:01:4b:3f, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa3c138e-d752-43f2-976c-4cbf1b65209d req-d41745cb-b114-4f1c-b971-3ca0e3ed012f service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa3c138e-d752-43f2-976c-4cbf1b65209d req-d41745cb-b114-4f1c-b971-3ca0e3ed012f service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa3c138e-d752-43f2-976c-4cbf1b65209d req-d41745cb-b114-4f1c-b971-3ca0e3ed012f service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa3c138e-d752-43f2-976c-4cbf1b65209d req-d41745cb-b114-4f1c-b971-3ca0e3ed012f service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa3c138e-d752-43f2-976c-4cbf1b65209d req-d41745cb-b114-4f1c-b971-3ca0e3ed012f service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:08 user nova-compute[72793]: WARNING nova.compute.manager [req-aa3c138e-d752-43f2-976c-4cbf1b65209d req-d41745cb-b114-4f1c-b971-3ca0e3ed012f service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state active and task_state rescuing.
Aug 17 04:16:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:10 user nova-compute[72793]: WARNING nova.compute.manager [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state active and task_state rescuing.
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:10 user nova-compute[72793]: WARNING nova.compute.manager [req-2f39b6df-788a-4f6f-8432-677a00a2f34c req-3c0a83bb-d394-4ec4-8fcf-697d5bdfb569 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state active and task_state rescuing.
Aug 17 04:16:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for dae77365-0f83-4512-ac59-c2ca7c692feb due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245770.8106189, dae77365-0f83-4512-ac59-c2ca7c692feb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:16:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Resumed (Lifecycle Event)
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2e6444d6-8cee-41df-91b5-0e1896836713 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:16:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245770.813131, dae77365-0f83-4512-ac59-c2ca7c692feb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:16:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Started (Lifecycle Event)
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:16:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:16:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:16:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7056MB free_disk=24.893009185791016GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 47728048-3982-4001-b08e-43c6bd06f7bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8ffa2387-a317-4b02-90be-797d8de5c6b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "47728048-3982-4001-b08e-43c6bd06f7bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:21 user nova-compute[72793]: INFO nova.compute.manager [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Terminating instance
Aug 17 04:16:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-f38c49f8-d43a-49c3-a897-f749882c4331 req-aa34e96c-a907-4261-875d-abef1f8fcb88 service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-vif-unplugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f38c49f8-d43a-49c3-a897-f749882c4331 req-aa34e96c-a907-4261-875d-abef1f8fcb88 service nova] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f38c49f8-d43a-49c3-a897-f749882c4331 req-aa34e96c-a907-4261-875d-abef1f8fcb88 service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f38c49f8-d43a-49c3-a897-f749882c4331 req-aa34e96c-a907-4261-875d-abef1f8fcb88 service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-f38c49f8-d43a-49c3-a897-f749882c4331 req-aa34e96c-a907-4261-875d-abef1f8fcb88 service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] No waiting events found dispatching network-vif-unplugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.compute.manager [req-f38c49f8-d43a-49c3-a897-f749882c4331 req-aa34e96c-a907-4261-875d-abef1f8fcb88 service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-vif-unplugged-aa74582f-cda3-4b47-b753-e7b03d05345e for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:16:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Instance destroyed successfully.
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.objects.instance [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lazy-loading 'resources' on Instance uuid 47728048-3982-4001-b08e-43c6bd06f7bb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:14:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1065658462',display_name='tempest-ServersNegativeTestJSON-server-1065658462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1065658462',id=36,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ff1feab57f4390be7855b073d7c634',ramdisk_id='',reservation_id='r-ga07ttd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-698989669',owner_user_name='tempest-ServersNegativeTestJSON-698989669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:14:38Z,user_data=None,user_id='ad60fa5186024d2e8c03a99d8b90834a',uuid=47728048-3982-4001-b08e-43c6bd06f7bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converting VIF {"id": "aa74582f-cda3-4b47-b753-e7b03d05345e", "address": "fa:16:3e:60:ab:ce", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa74582f-cd", "ovs_interfaceid": "aa74582f-cda3-4b47-b753-e7b03d05345e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG os_vif [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa74582f-cd, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:16:22 user nova-compute[72793]: INFO os_vif [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:ab:ce,bridge_name='br-int',has_traffic_filtering=True,id=aa74582f-cda3-4b47-b753-e7b03d05345e,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa74582f-cd')
Aug 17 04:16:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Deleting instance files /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb_del
Aug 17 04:16:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Deletion of /opt/stack/data/nova/instances/47728048-3982-4001-b08e-43c6bd06f7bb_del complete
Aug 17 04:16:22 user nova-compute[72793]: INFO nova.compute.manager [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 04:16:22 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:16:22 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:23 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Took 0.82 seconds to deallocate network for instance.
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-a9bcd19e-e24d-4894-9d56-1902fa7f9fb8 req-4d1f30f1-573d-4131-b7c1-80d505849f6a service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-vif-deleted-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:23 user nova-compute[72793]: INFO nova.compute.manager [req-a9bcd19e-e24d-4894-9d56-1902fa7f9fb8 req-4d1f30f1-573d-4131-b7c1-80d505849f6a service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Neutron deleted interface aa74582f-cda3-4b47-b753-e7b03d05345e; detaching it from the instance and deleting it from the info cache
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.network.neutron [req-a9bcd19e-e24d-4894-9d56-1902fa7f9fb8 req-4d1f30f1-573d-4131-b7c1-80d505849f6a service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-a9bcd19e-e24d-4894-9d56-1902fa7f9fb8 req-4d1f30f1-573d-4131-b7c1-80d505849f6a service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Detach interface failed, port_id=aa74582f-cda3-4b47-b753-e7b03d05345e, reason: Instance 47728048-3982-4001-b08e-43c6bd06f7bb could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:23 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Deleted allocations for instance 47728048-3982-4001-b08e-43c6bd06f7bb
Aug 17 04:16:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-590b5cd5-cdc1-40b1-89f0-be2564b233d1 tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "47728048-3982-4001-b08e-43c6bd06f7bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [{"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-c7f6a855-05f1-4019-89a2-5fd75e206edc" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG nova.compute.manager [req-82a3f530-5ed0-4ea4-b746-ff5bd9aed6f3 req-55b30571-a1f8-445e-8240-5d96d9c752d8 service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received event network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82a3f530-5ed0-4ea4-b746-ff5bd9aed6f3 req-55b30571-a1f8-445e-8240-5d96d9c752d8 service nova] Acquiring lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82a3f530-5ed0-4ea4-b746-ff5bd9aed6f3 req-55b30571-a1f8-445e-8240-5d96d9c752d8 service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-82a3f530-5ed0-4ea4-b746-ff5bd9aed6f3 req-55b30571-a1f8-445e-8240-5d96d9c752d8 service nova] Lock "47728048-3982-4001-b08e-43c6bd06f7bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:24 user nova-compute[72793]: DEBUG nova.compute.manager [req-82a3f530-5ed0-4ea4-b746-ff5bd9aed6f3 req-55b30571-a1f8-445e-8240-5d96d9c752d8 service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] No waiting events found dispatching network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:24 user nova-compute[72793]: WARNING nova.compute.manager [req-82a3f530-5ed0-4ea4-b746-ff5bd9aed6f3 req-55b30571-a1f8-445e-8240-5d96d9c752d8 service nova] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Received unexpected event network-vif-plugged-aa74582f-cda3-4b47-b753-e7b03d05345e for instance with vm_state deleted and task_state None.
Aug 17 04:16:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:36 user nova-compute[72793]: INFO nova.compute.manager [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Terminating instance
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-4f38f1af-afb9-41d0-88f9-10c761dbfbca req-c6fb41c1-d2d5-4c06-927e-a72bc6e99430 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-unplugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4f38f1af-afb9-41d0-88f9-10c761dbfbca req-c6fb41c1-d2d5-4c06-927e-a72bc6e99430 service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4f38f1af-afb9-41d0-88f9-10c761dbfbca req-c6fb41c1-d2d5-4c06-927e-a72bc6e99430 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4f38f1af-afb9-41d0-88f9-10c761dbfbca req-c6fb41c1-d2d5-4c06-927e-a72bc6e99430 service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-4f38f1af-afb9-41d0-88f9-10c761dbfbca req-c6fb41c1-d2d5-4c06-927e-a72bc6e99430 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-unplugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-4f38f1af-afb9-41d0-88f9-10c761dbfbca req-c6fb41c1-d2d5-4c06-927e-a72bc6e99430 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-unplugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Instance destroyed successfully.
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'resources' on Instance uuid 758b73d6-9b4c-46cc-be56-a17f56709cf4 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1382367539',display_name='tempest-ServerActionsTestOtherA-server-1382367539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1382367539',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-0388eifl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=758b73d6-9b4c-46cc-be56-a17f56709cf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "address": "fa:16:3e:5b:97:0b", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap136a24c8-e6", "ovs_interfaceid": "136a24c8-e601-4edb-8343-e60ad8e27bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG os_vif [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap136a24c8-e6, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:36 user nova-compute[72793]: INFO os_vif [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:97:0b,bridge_name='br-int',has_traffic_filtering=True,id=136a24c8-e601-4edb-8343-e60ad8e27bd5,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap136a24c8-e6')
Aug 17 04:16:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:16:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVGusNEl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:16:36 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d6cac2-b35f-4481-aa90-cec50854d495]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[03606fcc-4162-4cb4-bbcc-038628702150]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:16:37 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:16:37 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:16:37 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:16:37 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:16:37 user nova-compute[72793]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 (non-flash)
Aug 17 04:16:37 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:16:37 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:16:37 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d064af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[418bf0c7-ec3f-409e-ab01-addf4ff55e6e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf5d134-44e0-405c-a85c-f39d36130226]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7142e9-6813-4f4b-b0d0-1987ab8d93dc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea166315-5245-44d8-8a2f-99c30f302fde]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.135s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[473026e6-7d11-4c08-b6b2-4cdac903c80c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0353771d-00c9-49d0-806e-85db0c536ac9]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260]
Aug 17 04:16:37 user nova-compute[72793]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193, portal: 172.16.0.220,3260] successful.
Aug 17 04:16:37 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06eeb596-a6d1-4bd6-b628-8ef789462193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d0cab-692a-47f0-9091-c1367cb953fe]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] <== disconnect_volume: return (462ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:16:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Deleting instance files /opt/stack/data/nova/instances/758b73d6-9b4c-46cc-be56-a17f56709cf4_del
Aug 17 04:16:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Deletion of /opt/stack/data/nova/instances/758b73d6-9b4c-46cc-be56-a17f56709cf4_del complete
Aug 17 04:16:37 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245782.460262, 47728048-3982-4001-b08e-43c6bd06f7bb => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:16:37 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] VM Stopped (Lifecycle Event)
Aug 17 04:16:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-83896adf-6979-4740-9a75-bd25ebe47cb9 None None] [instance: 47728048-3982-4001-b08e-43c6bd06f7bb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:37 user nova-compute[72793]: INFO nova.compute.manager [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 17 04:16:37 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:16:37 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-e8dc164e-941e-42c9-b5f1-8834babdf734 req-eb972b9c-fc9e-41d1-ba23-5834b431f172 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-deleted-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:38 user nova-compute[72793]: INFO nova.compute.manager [req-e8dc164e-941e-42c9-b5f1-8834babdf734 req-eb972b9c-fc9e-41d1-ba23-5834b431f172 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Neutron deleted interface 136a24c8-e601-4edb-8343-e60ad8e27bd5; detaching it from the instance and deleting it from the info cache
Aug 17 04:16:38 user nova-compute[72793]: DEBUG nova.network.neutron [req-e8dc164e-941e-42c9-b5f1-8834babdf734 req-eb972b9c-fc9e-41d1-ba23-5834b431f172 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:38 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Took 0.79 seconds to deallocate network for instance.
Aug 17 04:16:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-e8dc164e-941e-42c9-b5f1-8834babdf734 req-eb972b9c-fc9e-41d1-ba23-5834b431f172 service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Detach interface failed, port_id=136a24c8-e601-4edb-8343-e60ad8e27bd5, reason: Instance 758b73d6-9b4c-46cc-be56-a17f56709cf4 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-dea9bc2f-b963-499c-bfbf-9aa65c69ed6a req-2eb063d1-c9a8-476b-bf9b-90cacfac8e0d service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dea9bc2f-b963-499c-bfbf-9aa65c69ed6a req-2eb063d1-c9a8-476b-bf9b-90cacfac8e0d service nova] Acquiring lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dea9bc2f-b963-499c-bfbf-9aa65c69ed6a req-2eb063d1-c9a8-476b-bf9b-90cacfac8e0d service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-dea9bc2f-b963-499c-bfbf-9aa65c69ed6a req-2eb063d1-c9a8-476b-bf9b-90cacfac8e0d service nova] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-dea9bc2f-b963-499c-bfbf-9aa65c69ed6a req-2eb063d1-c9a8-476b-bf9b-90cacfac8e0d service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] No waiting events found dispatching network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:38 user nova-compute[72793]: WARNING nova.compute.manager [req-dea9bc2f-b963-499c-bfbf-9aa65c69ed6a req-2eb063d1-c9a8-476b-bf9b-90cacfac8e0d service nova] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Received unexpected event network-vif-plugged-136a24c8-e601-4edb-8343-e60ad8e27bd5 for instance with vm_state active and task_state deleting.
Aug 17 04:16:40 user nova-compute[72793]: INFO nova.compute.manager [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Took 1.69 seconds to detach 1 volumes for instance.
Aug 17 04:16:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Deleting volume: 06eeb596-a6d1-4bd6-b628-8ef789462193 {{(pid=72793) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 04:16:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:40 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:16:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:16:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:40 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Deleted allocations for instance 758b73d6-9b4c-46cc-be56-a17f56709cf4
Aug 17 04:16:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed8b3b9a-7bbf-4353-a1ac-5f2fbebb40a9 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "758b73d6-9b4c-46cc-be56-a17f56709cf4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.751s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:50 user nova-compute[72793]: INFO nova.compute.manager [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Terminating instance
Aug 17 04:16:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-a3731871-0fd3-44e0-b037-1ed68f0af5f9 req-d3d86368-91cf-485f-a77c-02d8b629e004 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-unplugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a3731871-0fd3-44e0-b037-1ed68f0af5f9 req-d3d86368-91cf-485f-a77c-02d8b629e004 service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a3731871-0fd3-44e0-b037-1ed68f0af5f9 req-d3d86368-91cf-485f-a77c-02d8b629e004 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a3731871-0fd3-44e0-b037-1ed68f0af5f9 req-d3d86368-91cf-485f-a77c-02d8b629e004 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-a3731871-0fd3-44e0-b037-1ed68f0af5f9 req-d3d86368-91cf-485f-a77c-02d8b629e004 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-unplugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-a3731871-0fd3-44e0-b037-1ed68f0af5f9 req-d3d86368-91cf-485f-a77c-02d8b629e004 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-unplugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:16:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Instance destroyed successfully.
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.objects.instance [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lazy-loading 'resources' on Instance uuid 8ffa2387-a317-4b02-90be-797d8de5c6b9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T04:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-362401097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-362401097',id=31,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzVcsyfpu/dNQgtTdJSiJg8n9aFu3HLg5KwUrSwfsJ+0by6pPeXq6kZOQYpp4+JC/c27Uwf6kkW6EMeQaf8xNjvNxpyQrPSQDS8jkeGXIVQTfh/yhdNm0M/dm/T+S3Wjg==',key_name='tempest-keypair-1719939993',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f916dfd267de46389faa83f4947db86f',ramdisk_id='',reservation_id='r-k8m4wj6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-266550928',owner_user_name='tempest-AttachVolumeShelveTestJSON-266550928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1420f8967734176ac04ac8b1e2646ea',uuid=8ffa2387-a317-4b02-90be-797d8de5c6b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converting VIF {"id": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "address": "fa:16:3e:d6:04:ee", "network": {"id": "4bf51a81-6240-4ab6-ba85-14ee07ddb59d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1571822351-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f916dfd267de46389faa83f4947db86f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9fdf7ae-ef", "ovs_interfaceid": "d9fdf7ae-ef51-4807-b307-ab01e770070b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG os_vif [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9fdf7ae-ef, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:51 user nova-compute[72793]: INFO os_vif [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:04:ee,bridge_name='br-int',has_traffic_filtering=True,id=d9fdf7ae-ef51-4807-b307-ab01e770070b,network=Network(4bf51a81-6240-4ab6-ba85-14ee07ddb59d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9fdf7ae-ef')
Aug 17 04:16:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Deleting instance files /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9_del
Aug 17 04:16:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Deletion of /opt/stack/data/nova/instances/8ffa2387-a317-4b02-90be-797d8de5c6b9_del complete
Aug 17 04:16:51 user nova-compute[72793]: INFO nova.compute.manager [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 04:16:51 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245796.9543014, 758b73d6-9b4c-46cc-be56-a17f56709cf4 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:16:51 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] VM Stopped (Lifecycle Event)
Aug 17 04:16:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-66fd24be-7fbf-4378-9af3-6596b6992d54 None None] [instance: 758b73d6-9b4c-46cc-be56-a17f56709cf4] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:52 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Took 0.79 seconds to deallocate network for instance.
Aug 17 04:16:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-ec1d88f5-b9d8-4d6a-a657-34068e6ff60c req-1f1d156f-e6aa-4580-a2ea-4038e3f49541 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-deleted-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:52 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Deleted allocations for instance 8ffa2387-a317-4b02-90be-797d8de5c6b9
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-355c7f7d-5ba7-4da8-9463-16e27c1043c5 tempest-AttachVolumeShelveTestJSON-266550928 tempest-AttachVolumeShelveTestJSON-266550928-project-member] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebf49be3-8f46-4015-9add-bf7f59626a13 req-7e2beb34-7865-41ba-b4dd-c470b13fdfc5 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebf49be3-8f46-4015-9add-bf7f59626a13 req-7e2beb34-7865-41ba-b4dd-c470b13fdfc5 service nova] Acquiring lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebf49be3-8f46-4015-9add-bf7f59626a13 req-7e2beb34-7865-41ba-b4dd-c470b13fdfc5 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ebf49be3-8f46-4015-9add-bf7f59626a13 req-7e2beb34-7865-41ba-b4dd-c470b13fdfc5 service nova] Lock "8ffa2387-a317-4b02-90be-797d8de5c6b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-ebf49be3-8f46-4015-9add-bf7f59626a13 req-7e2beb34-7865-41ba-b4dd-c470b13fdfc5 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] No waiting events found dispatching network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:52 user nova-compute[72793]: WARNING nova.compute.manager [req-ebf49be3-8f46-4015-9add-bf7f59626a13 req-7e2beb34-7865-41ba-b4dd-c470b13fdfc5 service nova] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Received unexpected event network-vif-plugged-d9fdf7ae-ef51-4807-b307-ab01e770070b for instance with vm_state deleted and task_state None.
Aug 17 04:16:55 user nova-compute[72793]: INFO nova.compute.manager [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Unrescuing
Aug 17 04:16:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquired lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Updating instance_info_cache with network_info: [{"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Releasing lock "refresh_cache-3492c76f-a8cc-4db3-b2a8-6b661597d0ef" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'flavor' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-3d09ff32-a949-4a5f-9d15-0fcc761280f7 req-6003481a-faa0-4205-937c-c9e217d62865 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3d09ff32-a949-4a5f-9d15-0fcc761280f7 req-6003481a-faa0-4205-937c-c9e217d62865 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3d09ff32-a949-4a5f-9d15-0fcc761280f7 req-6003481a-faa0-4205-937c-c9e217d62865 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3d09ff32-a949-4a5f-9d15-0fcc761280f7 req-6003481a-faa0-4205-937c-c9e217d62865 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-3d09ff32-a949-4a5f-9d15-0fcc761280f7 req-6003481a-faa0-4205-937c-c9e217d62865 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:55 user nova-compute[72793]: WARNING nova.compute.manager [req-3d09ff32-a949-4a5f-9d15-0fcc761280f7 req-6003481a-faa0-4205-937c-c9e217d62865 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:16:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance destroyed successfully.
Aug 17 04:16:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:58 user nova-compute[72793]: WARNING nova.compute.manager [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:16:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:16:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:16:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:16:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:16:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:16:58 user nova-compute[72793]: WARNING nova.compute.manager [req-79d4a4a2-ac23-47da-9315-efc5afad1f2d req-cdefdb2f-27bb-4a7f-9b21-40b6fcf006c5 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for 3492c76f-a8cc-4db3-b2a8-6b661597d0ef due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245819.7924445, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:16:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Resumed (Lifecycle Event)
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c5fc885f-a0d9-4fa4-b388-1130cef57188 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:16:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245819.7935393, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:16:59 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Started (Lifecycle Event)
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:16:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:17:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-848e903b-4221-4d75-a70b-c4a69ef0a1d5 req-7e4db650-8230-4739-961c-28ea70cfd69c service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-848e903b-4221-4d75-a70b-c4a69ef0a1d5 req-7e4db650-8230-4739-961c-28ea70cfd69c service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-848e903b-4221-4d75-a70b-c4a69ef0a1d5 req-7e4db650-8230-4739-961c-28ea70cfd69c service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-848e903b-4221-4d75-a70b-c4a69ef0a1d5 req-7e4db650-8230-4739-961c-28ea70cfd69c service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-848e903b-4221-4d75-a70b-c4a69ef0a1d5 req-7e4db650-8230-4739-961c-28ea70cfd69c service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:17:00 user nova-compute[72793]: WARNING nova.compute.manager [req-848e903b-4221-4d75-a70b-c4a69ef0a1d5 req-7e4db650-8230-4739-961c-28ea70cfd69c service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state None.
Aug 17 04:17:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245811.1954596, 8ffa2387-a317-4b02-90be-797d8de5c6b9 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:17:06 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] VM Stopped (Lifecycle Event)
Aug 17 04:17:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e880951a-5a0d-4add-92fc-cca6b8929ad9 None None] [instance: 8ffa2387-a317-4b02-90be-797d8de5c6b9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:17:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:17:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:17:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:17:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:17:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:17:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:14 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:15 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:17:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:17:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7519MB free_disk=24.94768524169922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance c7f6a855-05f1-4019-89a2-5fd75e206edc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:17:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:17:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:17:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:17:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updating instance_info_cache with network_info: [{"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-210d0b74-53d8-45d4-b4b4-691c18fc125b" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:17:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:17:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-changed-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Refreshing instance network info cache due to event network-changed-888c087b-6b68-4e2b-b054-cbd8fff1a96a. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] Acquiring lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] Acquired lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG nova.network.neutron [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Refreshing network info cache for port 888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG nova.network.neutron [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updated VIF entry in instance network info cache for port 888c087b-6b68-4e2b-b054-cbd8fff1a96a. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:17:28 user nova-compute[72793]: DEBUG nova.network.neutron [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updating instance_info_cache with network_info: [{"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG nova.objects.instance [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'flavor' on Instance uuid 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa3f04a3-d8b0-46be-b51c-713720386b71 req-f3178013-3c9e-4407-99f0-63b26c9689df service nova] Releasing lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:29 user nova-compute[72793]: INFO nova.compute.manager [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Attaching volume a479fb0f-b1ce-4a5f-b1db-e38449a843c6 to /dev/vdb
Aug 17 04:17:29 user nova-compute[72793]: DEBUG os_brick.utils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac09a5-58ca-4962-81e3-4ec1631eb050]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[de82edbc-92eb-44d0-85c9-c762b456fd6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b79a52-98ee-4c23-b705-09ce867b1dc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a13f1-fc75-4e39-95d6-3779b13493a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:17:29 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:17:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32069c-d8b4-450f-8539-7ce57a95428c]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG os_brick.utils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:17:29 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updating existing volume attachment record: 8df22873-480d-4257-8821-ef49950422f2 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:17:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:33 user nova-compute[72793]: INFO nova.compute.manager [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Terminating instance
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-216f049f-bf93-4aea-a577-53c5df3a8372 req-e1d04ee0-b753-47ab-bc0e-8dd66fb179bd service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-vif-unplugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-216f049f-bf93-4aea-a577-53c5df3a8372 req-e1d04ee0-b753-47ab-bc0e-8dd66fb179bd service nova] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-216f049f-bf93-4aea-a577-53c5df3a8372 req-e1d04ee0-b753-47ab-bc0e-8dd66fb179bd service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-216f049f-bf93-4aea-a577-53c5df3a8372 req-e1d04ee0-b753-47ab-bc0e-8dd66fb179bd service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-216f049f-bf93-4aea-a577-53c5df3a8372 req-e1d04ee0-b753-47ab-bc0e-8dd66fb179bd service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] No waiting events found dispatching network-vif-unplugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-216f049f-bf93-4aea-a577-53c5df3a8372 req-e1d04ee0-b753-47ab-bc0e-8dd66fb179bd service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-vif-unplugged-85751269-3e2b-4a54-a738-f2532f5d07b9 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Instance destroyed successfully.
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lazy-loading 'resources' on Instance uuid c7f6a855-05f1-4019-89a2-5fd75e206edc {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T03:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1315053363',display_name='tempest-ServerActionsTestOtherA-server-1315053363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1315053363',id=3,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOIeSPTosIbmjehl8a436hhlgLb1G5dzkV9h+hDij8tahJVFoX7fpxj8/SJ9ZMF632OUYzoN9jGg4Nj2xGDtSDZpu97V2LO/W77UuI4sgQOp+sG1jIqHBP9hJr3Rh2fSA==',key_name='tempest-keypair-439751714',keypairs=<?>,launch_index=0,launched_at=2023-08-17T03:57:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c6b688c6c95499ab90009d73f378a92',ramdisk_id='',reservation_id='r-g5ws0s23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1498578162',owner_user_name='tempest-ServerActionsTestOtherA-1498578162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T03:57:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='65891e5eae334ee38675df619856db02',uuid=c7f6a855-05f1-4019-89a2-5fd75e206edc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converting VIF {"id": "85751269-3e2b-4a54-a738-f2532f5d07b9", "address": "fa:16:3e:24:7a:e2", "network": {"id": "4a817ca4-a25f-4421-9f2e-75321bbb6d49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-413533841-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c6b688c6c95499ab90009d73f378a92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85751269-3e", "ovs_interfaceid": "85751269-3e2b-4a54-a738-f2532f5d07b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG os_vif [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85751269-3e, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:17:33 user nova-compute[72793]: INFO os_vif [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:7a:e2,bridge_name='br-int',has_traffic_filtering=True,id=85751269-3e2b-4a54-a738-f2532f5d07b9,network=Network(4a817ca4-a25f-4421-9f2e-75321bbb6d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85751269-3e')
Aug 17 04:17:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Deleting instance files /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc_del
Aug 17 04:17:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Deletion of /opt/stack/data/nova/instances/c7f6a855-05f1-4019-89a2-5fd75e206edc_del complete
Aug 17 04:17:34 user nova-compute[72793]: INFO nova.compute.manager [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 04:17:34 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:17:34 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Took 0.44 seconds to deallocate network for instance.
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-90997c93-f5d2-4e3f-a9a8-aea8c3500967 req-69f24971-8478-4a11-93cf-36e93cf1850c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-vif-deleted-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:34 user nova-compute[72793]: INFO nova.compute.manager [req-90997c93-f5d2-4e3f-a9a8-aea8c3500967 req-69f24971-8478-4a11-93cf-36e93cf1850c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Neutron deleted interface 85751269-3e2b-4a54-a738-f2532f5d07b9; detaching it from the instance and deleting it from the info cache
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.network.neutron [req-90997c93-f5d2-4e3f-a9a8-aea8c3500967 req-69f24971-8478-4a11-93cf-36e93cf1850c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-90997c93-f5d2-4e3f-a9a8-aea8c3500967 req-69f24971-8478-4a11-93cf-36e93cf1850c service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Detach interface failed, port_id=85751269-3e2b-4a54-a738-f2532f5d07b9, reason: Instance c7f6a855-05f1-4019-89a2-5fd75e206edc could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:17:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:34 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Deleted allocations for instance c7f6a855-05f1-4019-89a2-5fd75e206edc
Aug 17 04:17:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-880e69a6-dda9-4ff5-9cd7-4acd7a4faa43 tempest-ServerActionsTestOtherA-1498578162 tempest-ServerActionsTestOtherA-1498578162-project-member] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-527b5a2e-f95b-4a05-ace4-3f6810171c4b req-2ce3a61e-8b30-44ae-bd23-08905287741b service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received event network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-527b5a2e-f95b-4a05-ace4-3f6810171c4b req-2ce3a61e-8b30-44ae-bd23-08905287741b service nova] Acquiring lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-527b5a2e-f95b-4a05-ace4-3f6810171c4b req-2ce3a61e-8b30-44ae-bd23-08905287741b service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-527b5a2e-f95b-4a05-ace4-3f6810171c4b req-2ce3a61e-8b30-44ae-bd23-08905287741b service nova] Lock "c7f6a855-05f1-4019-89a2-5fd75e206edc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-527b5a2e-f95b-4a05-ace4-3f6810171c4b req-2ce3a61e-8b30-44ae-bd23-08905287741b service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] No waiting events found dispatching network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:17:35 user nova-compute[72793]: WARNING nova.compute.manager [req-527b5a2e-f95b-4a05-ace4-3f6810171c4b req-2ce3a61e-8b30-44ae-bd23-08905287741b service nova] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Received unexpected event network-vif-plugged-85751269-3e2b-4a54-a738-f2532f5d07b9 for instance with vm_state deleted and task_state None.
Aug 17 04:17:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsbiTYQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:17:40 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:17:40 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:17:40 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a3425-ca43-4213-82fa-5bb5571308b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:17:40 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fd0c3-1e06-4fd8-98f2-830eebedfcf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6] added
Aug 17 04:17:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.055s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee434c-3d15-43d4-adf6-1d0356f0f41c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af4594-2d14-4a2d-8085-cbb0ea5539ea]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsbiTYQx {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsbiTYQx" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[37778688-5c4f-432d-8fb2-76b07134bf5f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vsbiTYQx'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaaf60b-268e-48a0-bb9d-f7609a3f0f25]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7e60c-0a54-4257-8bf5-2051268e9ea4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[53255f3a-ae86-4cae-a106-eaa92dcfe3f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260]
Aug 17 04:17:40 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260] successful.
Aug 17 04:17:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc9dd8f-1147-48a7-8dbf-8787f58f0f97]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e17fdb-501f-46ad-8e0d-7c893adaaad2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 (non-flash)
Aug 17 04:17:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a95c1f-766d-48d4-b025-41773611d7a3]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:17:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsbiTYQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:17:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:17:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23666353865333336', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:17:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666353865333336', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:17:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'flavor' on Instance uuid 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:17:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:17:41 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:17:41 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:17:41 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:17:41 user nova-compute[72793]:   <serial>a479fb0f-b1ce-4a5f-b1db-e38449a843c6</serial>
Aug 17 04:17:41 user nova-compute[72793]: </disk>
Aug 17 04:17:41 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:17:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:17:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:17:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] No VIF found with MAC fa:16:3e:a2:9e:50, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:17:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d7c57568-e7a6-45b7-a9fb-d0c1189c687c tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.108s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:44 user nova-compute[72793]: INFO nova.compute.manager [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Detaching volume a479fb0f-b1ce-4a5f-b1db-e38449a843c6
Aug 17 04:17:44 user nova-compute[72793]: INFO nova.virt.block_device [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Attempting to driver detach volume a479fb0f-b1ce-4a5f-b1db-e38449a843c6 from mountpoint /dev/vdb
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Attempting to detach device vdb from instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:17:44 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:17:44 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:17:44 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:17:44 user nova-compute[72793]:   <serial>a479fb0f-b1ce-4a5f-b1db-e38449a843c6</serial>
Aug 17 04:17:44 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:17:44 user nova-compute[72793]: </disk>
Aug 17 04:17:44 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:17:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully detached device vdb from instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 from the persistent domain config.
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:17:44 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:17:44 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:17:44 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:17:44 user nova-compute[72793]:   <serial>a479fb0f-b1ce-4a5f-b1db-e38449a843c6</serial>
Aug 17 04:17:44 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:17:44 user nova-compute[72793]: </disk>
Aug 17 04:17:44 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245864.7626305, 103e1896-9e0f-4533-9c10-a9eb2dca5012 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:17:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully detached device vdb from instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 from the live domain config.
Aug 17 04:17:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsbiTYQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:17:44 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da58f56-5667-40c9-aecf-4310e98cd499]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd35d68-636b-4946-9409-0d76b3359ac2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:17:44 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:17:44 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:17:44 user nova-compute[72793]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 (non-flash)
Aug 17 04:17:44 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:17:44 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:17:44 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:17:44 user nova-compute[72793]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 (non-flash)
Aug 17 04:17:44 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02cbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c818c287-c242-4d29-8b74-8b851d866b95]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea6fcbe-b828-4c20-aa19-ba71307f02d0]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10c2e46-9b46-4301-a869-e331fc5cb1fb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd01cc3-72ce-40ff-9bfb-c98d4748e1b1]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ed802-d61d-4c96-bc64-60d44585c844]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[93544f93-17ca-4525-9816-dba45f8a158f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260]
Aug 17 04:17:45 user nova-compute[72793]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6, portal: 172.16.0.220,3260] successful.
Aug 17 04:17:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a479fb0f-b1ce-4a5f-b1db-e38449a843c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a499344-fc00-4b6d-9e5c-f34754df8df1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] <== disconnect_volume: return (312ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'flavor' on Instance uuid 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:17:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-340f408c-0933-474c-8b36-7fa202297f66 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:48 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245853.9199216, c7f6a855-05f1-4019-89a2-5fd75e206edc => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:17:48 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] VM Stopped (Lifecycle Event)
Aug 17 04:17:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-95ab38ac-60a2-42db-a1e8-3382e8f7b3e8 None None] [instance: c7f6a855-05f1-4019-89a2-5fd75e206edc] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:17:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:56 user nova-compute[72793]: INFO nova.compute.manager [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Unrescuing
Aug 17 04:17:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:17:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:17:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'flavor' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-37efd4ab-14e0-49bc-a4fd-86a8a097100e req-57177dfc-0edc-4413-8725-a5c565d260c2 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37efd4ab-14e0-49bc-a4fd-86a8a097100e req-57177dfc-0edc-4413-8725-a5c565d260c2 service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37efd4ab-14e0-49bc-a4fd-86a8a097100e req-57177dfc-0edc-4413-8725-a5c565d260c2 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37efd4ab-14e0-49bc-a4fd-86a8a097100e req-57177dfc-0edc-4413-8725-a5c565d260c2 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-37efd4ab-14e0-49bc-a4fd-86a8a097100e req-57177dfc-0edc-4413-8725-a5c565d260c2 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:17:57 user nova-compute[72793]: WARNING nova.compute.manager [req-37efd4ab-14e0-49bc-a4fd-86a8a097100e req-57177dfc-0edc-4413-8725-a5c565d260c2 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:17:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:57 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance destroyed successfully.
Aug 17 04:17:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:17:59 user nova-compute[72793]: WARNING nova.compute.manager [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:17:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:17:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:17:59 user nova-compute[72793]: WARNING nova.compute.manager [req-63aba29f-7188-4d56-934a-1abaf4c78842 req-82eebe47-e81b-446d-97ba-7031f40fa4ee service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state rescued and task_state unrescuing.
Aug 17 04:18:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Removed pending event for dae77365-0f83-4512-ac59-c2ca7c692feb due to event {{(pid=72793) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245881.3760004, dae77365-0f83-4512-ac59-c2ca7c692feb => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Resumed (Lifecycle Event)
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fcc7bb48-1ffd-4c08-9b29-b04695cc82c6 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:18:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245881.377953, dae77365-0f83-4512-ac59-c2ca7c692feb => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:01 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Started (Lifecycle Event)
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-038da3d3-adc3-40d6-a24e-7710eb3c083d req-3b615f2d-2db8-46c1-b1e6-adda751d7a86 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-038da3d3-adc3-40d6-a24e-7710eb3c083d req-3b615f2d-2db8-46c1-b1e6-adda751d7a86 service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-038da3d3-adc3-40d6-a24e-7710eb3c083d req-3b615f2d-2db8-46c1-b1e6-adda751d7a86 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-038da3d3-adc3-40d6-a24e-7710eb3c083d req-3b615f2d-2db8-46c1-b1e6-adda751d7a86 service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:01 user nova-compute[72793]: DEBUG nova.compute.manager [req-038da3d3-adc3-40d6-a24e-7710eb3c083d req-3b615f2d-2db8-46c1-b1e6-adda751d7a86 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:01 user nova-compute[72793]: WARNING nova.compute.manager [req-038da3d3-adc3-40d6-a24e-7710eb3c083d req-3b615f2d-2db8-46c1-b1e6-adda751d7a86 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state active and task_state None.
Aug 17 04:18:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:09 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:18:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:18:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:16 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:18:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:18:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=24.964035034179688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 103e1896-9e0f-4533-9c10-a9eb2dca5012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:18:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:18:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:18:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:18:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:18:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.821s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:18:24 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [{"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-d3b38fd0-f823-4a39-927a-52c064339731" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:18:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:18:28 user nova-compute[72793]: INFO nova.compute.claims [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Claim successful on node user
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.network.neutron [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:18:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.policy [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20e14d27758f4d06ada663158d4a86e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed7012002c5470791e96bc238218fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:18:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Creating image(s)
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "/opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "/opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk 1073741824" returned: 0 in 0.053s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG nova.network.neutron [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Successfully created port: f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Cannot resize image /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG nova.objects.instance [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lazy-loading 'migration_context' on Instance uuid 6d28a716-02d3-4311-b625-c15e13a95b9d {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Ensure instance console log exists: /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Successfully updated port: f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "refresh_cache-6d28a716-02d3-4311-b625-c15e13a95b9d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquired lock "refresh_cache-6d28a716-02d3-4311-b625-c15e13a95b9d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-changed-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Refreshing instance network info cache due to event network-changed-f88b7049-9018-4b9f-9ccf-90ac58ffe7df. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] Acquiring lock "refresh_cache-6d28a716-02d3-4311-b625-c15e13a95b9d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Updating instance_info_cache with network_info: [{"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Releasing lock "refresh_cache-6d28a716-02d3-4311-b625-c15e13a95b9d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Instance network_info: |[{"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] Acquired lock "refresh_cache-6d28a716-02d3-4311-b625-c15e13a95b9d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Refreshing network info cache for port f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Start _get_guest_xml network_info=[{"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:18:30 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:18:30 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-235334498',display_name='tempest-VolumesActionsTest-instance-235334498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-235334498',id=38,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed7012002c5470791e96bc238218fa8',ramdisk_id='',reservation_id='r-ppvn0j9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-467590366',owner_user_name='tempest-VolumesActionsTest-467590366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:18:29Z,user_data=None,user_id='20e14d27758f4d06ada663158d4a86e7',uuid=6d28a716-02d3-4311-b625-c15e13a95b9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Converting VIF {"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d28a716-02d3-4311-b625-c15e13a95b9d {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:18:30 user nova-compute[72793]:   <uuid>6d28a716-02d3-4311-b625-c15e13a95b9d</uuid>
Aug 17 04:18:30 user nova-compute[72793]:   <name>instance-00000026</name>
Aug 17 04:18:30 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:18:30 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:18:30 user nova-compute[72793]:   <metadata>
Aug 17 04:18:30 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:18:30 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:18:30 user nova-compute[72793]:       <nova:name>tempest-VolumesActionsTest-instance-235334498</nova:name>
Aug 17 04:18:30 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:18:30</nova:creationTime>
Aug 17 04:18:30 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:18:30 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:18:30 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:18:30 user nova-compute[72793]:       <nova:owner>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:user uuid="20e14d27758f4d06ada663158d4a86e7">tempest-VolumesActionsTest-467590366-project-member</nova:user>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:project uuid="bed7012002c5470791e96bc238218fa8">tempest-VolumesActionsTest-467590366</nova:project>
Aug 17 04:18:30 user nova-compute[72793]:       </nova:owner>
Aug 17 04:18:30 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:18:30 user nova-compute[72793]:       <nova:ports>
Aug 17 04:18:30 user nova-compute[72793]:         <nova:port uuid="f88b7049-9018-4b9f-9ccf-90ac58ffe7df">
Aug 17 04:18:30 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:18:30 user nova-compute[72793]:         </nova:port>
Aug 17 04:18:30 user nova-compute[72793]:       </nova:ports>
Aug 17 04:18:30 user nova-compute[72793]:     </nova:instance>
Aug 17 04:18:30 user nova-compute[72793]:   </metadata>
Aug 17 04:18:30 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:18:30 user nova-compute[72793]:     <system>
Aug 17 04:18:30 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:18:30 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:18:30 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:18:30 user nova-compute[72793]:       <entry name="serial">6d28a716-02d3-4311-b625-c15e13a95b9d</entry>
Aug 17 04:18:30 user nova-compute[72793]:       <entry name="uuid">6d28a716-02d3-4311-b625-c15e13a95b9d</entry>
Aug 17 04:18:30 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:18:30 user nova-compute[72793]:     </system>
Aug 17 04:18:30 user nova-compute[72793]:   </sysinfo>
Aug 17 04:18:30 user nova-compute[72793]:   <os>
Aug 17 04:18:30 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:18:30 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:18:30 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:18:30 user nova-compute[72793]:   </os>
Aug 17 04:18:30 user nova-compute[72793]:   <features>
Aug 17 04:18:30 user nova-compute[72793]:     <acpi/>
Aug 17 04:18:30 user nova-compute[72793]:     <apic/>
Aug 17 04:18:30 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:18:30 user nova-compute[72793]:   </features>
Aug 17 04:18:30 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:18:30 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:18:30 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:18:30 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:18:30 user nova-compute[72793]:   </clock>
Aug 17 04:18:30 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:18:30 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:18:30 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:18:30 user nova-compute[72793]:   </cpu>
Aug 17 04:18:30 user nova-compute[72793]:   <devices>
Aug 17 04:18:30 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:18:30 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:18:30 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk"/>
Aug 17 04:18:30 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:18:30 user nova-compute[72793]:     </disk>
Aug 17 04:18:30 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:18:30 user nova-compute[72793]:       <mac address="fa:16:3e:f6:be:bb"/>
Aug 17 04:18:30 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:18:30 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:18:30 user nova-compute[72793]:       <target dev="tapf88b7049-90"/>
Aug 17 04:18:30 user nova-compute[72793]:     </interface>
Aug 17 04:18:30 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:18:30 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/console.log" append="off"/>
Aug 17 04:18:30 user nova-compute[72793]:     </serial>
Aug 17 04:18:30 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:18:30 user nova-compute[72793]:     <video>
Aug 17 04:18:30 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:18:30 user nova-compute[72793]:     </video>
Aug 17 04:18:30 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:18:30 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:18:30 user nova-compute[72793]:     </rng>
Aug 17 04:18:30 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:18:30 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:18:30 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:18:30 user nova-compute[72793]:     </memballoon>
Aug 17 04:18:30 user nova-compute[72793]:   </devices>
Aug 17 04:18:30 user nova-compute[72793]: </domain>
Aug 17 04:18:30 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-235334498',display_name='tempest-VolumesActionsTest-instance-235334498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-235334498',id=38,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed7012002c5470791e96bc238218fa8',ramdisk_id='',reservation_id='r-ppvn0j9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-467590366',owner_user_name='tempest-VolumesActionsTest-467590366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:18:29Z,user_data=None,user_id='20e14d27758f4d06ada663158d4a86e7',uuid=6d28a716-02d3-4311-b625-c15e13a95b9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Converting VIF {"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG os_vif [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf88b7049-90, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf88b7049-90, col_values=(('external_ids', {'iface-id': 'f88b7049-9018-4b9f-9ccf-90ac58ffe7df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:be:bb', 'vm-uuid': '6d28a716-02d3-4311-b625-c15e13a95b9d'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:30 user nova-compute[72793]: INFO os_vif [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90')
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] No VIF found with MAC fa:16:3e:f6:be:bb, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Updated VIF entry in instance network info cache for port f88b7049-9018-4b9f-9ccf-90ac58ffe7df. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG nova.network.neutron [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Updating instance_info_cache with network_info: [{"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-774343ec-280d-475b-bab7-0c904fc50a63 req-af07e973-14d2-4a73-8ecb-43c1c0f4ec1f service nova] Releasing lock "refresh_cache-6d28a716-02d3-4311-b625-c15e13a95b9d" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:18:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-d471ad89-a091-464a-863b-ec2f59426144 req-76937423-4a3e-4d37-9da9-9fb1be5f7eec service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d471ad89-a091-464a-863b-ec2f59426144 req-76937423-4a3e-4d37-9da9-9fb1be5f7eec service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d471ad89-a091-464a-863b-ec2f59426144 req-76937423-4a3e-4d37-9da9-9fb1be5f7eec service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d471ad89-a091-464a-863b-ec2f59426144 req-76937423-4a3e-4d37-9da9-9fb1be5f7eec service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-d471ad89-a091-464a-863b-ec2f59426144 req-76937423-4a3e-4d37-9da9-9fb1be5f7eec service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:32 user nova-compute[72793]: WARNING nova.compute.manager [req-d471ad89-a091-464a-863b-ec2f59426144 req-76937423-4a3e-4d37-9da9-9fb1be5f7eec service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state building and task_state spawning.
Aug 17 04:18:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245914.1233637, 6d28a716-02d3-4311-b625-c15e13a95b9d => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] VM Resumed (Lifecycle Event)
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Instance spawned successfully.
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245914.126588, 6d28a716-02d3-4311-b625-c15e13a95b9d => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] VM Started (Lifecycle Event)
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-93b0ed54-61b0-44e1-8748-afba53c2479c req-0e6ced62-c80c-4660-851d-5b9068b81cdc service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93b0ed54-61b0-44e1-8748-afba53c2479c req-0e6ced62-c80c-4660-851d-5b9068b81cdc service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93b0ed54-61b0-44e1-8748-afba53c2479c req-0e6ced62-c80c-4660-851d-5b9068b81cdc service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-93b0ed54-61b0-44e1-8748-afba53c2479c req-0e6ced62-c80c-4660-851d-5b9068b81cdc service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:34 user nova-compute[72793]: DEBUG nova.compute.manager [req-93b0ed54-61b0-44e1-8748-afba53c2479c req-0e6ced62-c80c-4660-851d-5b9068b81cdc service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:34 user nova-compute[72793]: WARNING nova.compute.manager [req-93b0ed54-61b0-44e1-8748-afba53c2479c req-0e6ced62-c80c-4660-851d-5b9068b81cdc service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state building and task_state spawning.
Aug 17 04:18:34 user nova-compute[72793]: INFO nova.compute.manager [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Took 6.23 seconds to build instance.
Aug 17 04:18:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-81340bb2-2472-4bb8-9878-2b7a0fad6faf tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.320s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-changed-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Refreshing instance network info cache due to event network-changed-888c087b-6b68-4e2b-b054-cbd8fff1a96a. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] Acquiring lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] Acquired lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.network.neutron [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Refreshing network info cache for port 888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:36 user nova-compute[72793]: INFO nova.compute.manager [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Terminating instance
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-84626de6-4ff5-4225-9a01-5b107da5ce9e req-e40f9843-92ff-41f4-a28a-beb2a5a8cb64 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-vif-unplugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84626de6-4ff5-4225-9a01-5b107da5ce9e req-e40f9843-92ff-41f4-a28a-beb2a5a8cb64 service nova] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84626de6-4ff5-4225-9a01-5b107da5ce9e req-e40f9843-92ff-41f4-a28a-beb2a5a8cb64 service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-84626de6-4ff5-4225-9a01-5b107da5ce9e req-e40f9843-92ff-41f4-a28a-beb2a5a8cb64 service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-84626de6-4ff5-4225-9a01-5b107da5ce9e req-e40f9843-92ff-41f4-a28a-beb2a5a8cb64 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] No waiting events found dispatching network-vif-unplugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-84626de6-4ff5-4225-9a01-5b107da5ce9e req-e40f9843-92ff-41f4-a28a-beb2a5a8cb64 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-vif-unplugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:18:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.network.neutron [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updated VIF entry in instance network info cache for port 888c087b-6b68-4e2b-b054-cbd8fff1a96a. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.network.neutron [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updating instance_info_cache with network_info: [{"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-868ddf0e-a675-4446-9fc2-0861d3853c82 req-aa7c3572-7ac1-4e42-a1a7-41fee4d36c7f service nova] Releasing lock "refresh_cache-103e1896-9e0f-4533-9c10-a9eb2dca5012" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:18:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Instance destroyed successfully.
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'resources' on Instance uuid 103e1896-9e0f-4533-9c10-a9eb2dca5012 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1202399895',display_name='tempest-TestStampPattern-server-1202399895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1202399895',id=37,image_ref='bf3e75e2-c3d5-4563-8ceb-e6a6ff383808',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqB9t/3sSVxFk9/g96xP3rSFx0LEd2VPNOmRyPR0ztCb9JD+Im4SIlqAcSlRg4TJTgiGLSOyiJ+Bqo6d7fO59SFjP1HSGL8I2vjXUN6yYYLnoGGfgGlKAbcF/3Sh8woWw==',key_name='tempest-TestStampPattern-408149894',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:15:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d5df793fe4f43b6aa166ea78757d6c5',ramdisk_id='',reservation_id='r-sjcisnfv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5324b34b-1ce3-41c7-b3f3-47156e936a33',image_min_disk='1',image_min_ram='0',image_owner_id='6d5df793fe4f43b6aa166ea78757d6c5',image_owner_project_name='tempest-TestStampPattern-174584011',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-174584011-project-member',image_user_id='ec6ad70b73a9436387c6d5812b30d1f5',owner_project_name='tempest-TestStampPattern-174584011',owner_user_name='tempest-TestStampPattern-174584011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:15:43Z,user_data=None,user_id='ec6ad70b73a9436387c6d5812b30d1f5',uuid=103e1896-9e0f-4533-9c10-a9eb2dca5012,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converting VIF {"id": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "address": "fa:16:3e:a2:9e:50", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap888c087b-6b", "ovs_interfaceid": "888c087b-6b68-4e2b-b054-cbd8fff1a96a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG os_vif [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap888c087b-6b, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:18:37 user nova-compute[72793]: INFO os_vif [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:9e:50,bridge_name='br-int',has_traffic_filtering=True,id=888c087b-6b68-4e2b-b054-cbd8fff1a96a,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap888c087b-6b')
Aug 17 04:18:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Deleting instance files /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012_del
Aug 17 04:18:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Deletion of /opt/stack/data/nova/instances/103e1896-9e0f-4533-9c10-a9eb2dca5012_del complete
Aug 17 04:18:37 user nova-compute[72793]: INFO nova.compute.manager [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 04:18:37 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:18:37 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:38 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Took 0.79 seconds to deallocate network for instance.
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-028a23fd-5eba-4230-ab3e-052418cdda53 req-a879bf6a-3a62-4d96-a8e2-547cfc4b3ce4 service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-vif-deleted-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:38 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Deleted allocations for instance 103e1896-9e0f-4533-9c10-a9eb2dca5012
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6ebde351-35fd-4053-ad36-3d6470e6d2b2 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.242s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:38 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:18:38 user nova-compute[72793]: INFO nova.compute.claims [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Claim successful on node user
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd34ab6a-6d69-4e46-9161-ffc096becc14 req-bb2e0d14-799c-403a-a1a0-af43437b614f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received event network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd34ab6a-6d69-4e46-9161-ffc096becc14 req-bb2e0d14-799c-403a-a1a0-af43437b614f service nova] Acquiring lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd34ab6a-6d69-4e46-9161-ffc096becc14 req-bb2e0d14-799c-403a-a1a0-af43437b614f service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd34ab6a-6d69-4e46-9161-ffc096becc14 req-bb2e0d14-799c-403a-a1a0-af43437b614f service nova] Lock "103e1896-9e0f-4533-9c10-a9eb2dca5012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd34ab6a-6d69-4e46-9161-ffc096becc14 req-bb2e0d14-799c-403a-a1a0-af43437b614f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] No waiting events found dispatching network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:39 user nova-compute[72793]: WARNING nova.compute.manager [req-cd34ab6a-6d69-4e46-9161-ffc096becc14 req-bb2e0d14-799c-403a-a1a0-af43437b614f service nova] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Received unexpected event network-vif-plugged-888c087b-6b68-4e2b-b054-cbd8fff1a96a for instance with vm_state deleted and task_state None.
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:18:39 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.policy [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621ab8c1ef2c4af2a0baf1390a22ff56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12975ec6f4e740808d9bdd0be12181e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:18:39 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Creating image(s)
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk 1073741824" returned: 0 in 0.051s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Successfully created port: 3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Cannot resize image /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'migration_context' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Ensure instance console log exists: /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Successfully updated port: 3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquired lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:18:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-changed-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Refreshing instance network info cache due to event network-changed-3390ae2c-9541-4a17-bed3-7ae67a97404d. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] Acquiring lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updating instance_info_cache with network_info: [{"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Releasing lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Instance network_info: |[{"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] Acquired lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Refreshing network info cache for port 3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Start _get_guest_xml network_info=[{"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:18:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:18:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1695440738',display_name='tempest-AttachVolumeNegativeTest-server-1695440738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1695440738',id=39,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNva2kTToWZPgVohPtoYrknjlBYzOI4urpAl87eLPWOO3HdUOAIOQsfnyq4yCP9EwpRbg9hm1cCoj409E3skHeUTM8H7Mx05EpsAGYwUcz4fWp02MtgFKW2e/r2oE15hA==',key_name='tempest-keypair-168073618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-773lruh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:18:41 user nova-compute[72793]:   <uuid>4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd</uuid>
Aug 17 04:18:41 user nova-compute[72793]:   <name>instance-00000027</name>
Aug 17 04:18:41 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:18:41 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:18:41 user nova-compute[72793]:   <metadata>
Aug 17 04:18:41 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:18:41 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:18:41 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1695440738</nova:name>
Aug 17 04:18:41 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:18:41</nova:creationTime>
Aug 17 04:18:41 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:18:41 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:18:41 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:18:41 user nova-compute[72793]:       <nova:owner>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:user uuid="621ab8c1ef2c4af2a0baf1390a22ff56">tempest-AttachVolumeNegativeTest-1865038023-project-member</nova:user>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:project uuid="12975ec6f4e740808d9bdd0be12181e7">tempest-AttachVolumeNegativeTest-1865038023</nova:project>
Aug 17 04:18:41 user nova-compute[72793]:       </nova:owner>
Aug 17 04:18:41 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:18:41 user nova-compute[72793]:       <nova:ports>
Aug 17 04:18:41 user nova-compute[72793]:         <nova:port uuid="3390ae2c-9541-4a17-bed3-7ae67a97404d">
Aug 17 04:18:41 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 04:18:41 user nova-compute[72793]:         </nova:port>
Aug 17 04:18:41 user nova-compute[72793]:       </nova:ports>
Aug 17 04:18:41 user nova-compute[72793]:     </nova:instance>
Aug 17 04:18:41 user nova-compute[72793]:   </metadata>
Aug 17 04:18:41 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:18:41 user nova-compute[72793]:     <system>
Aug 17 04:18:41 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:18:41 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:18:41 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:18:41 user nova-compute[72793]:       <entry name="serial">4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd</entry>
Aug 17 04:18:41 user nova-compute[72793]:       <entry name="uuid">4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd</entry>
Aug 17 04:18:41 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:18:41 user nova-compute[72793]:     </system>
Aug 17 04:18:41 user nova-compute[72793]:   </sysinfo>
Aug 17 04:18:41 user nova-compute[72793]:   <os>
Aug 17 04:18:41 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:18:41 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:18:41 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:18:41 user nova-compute[72793]:   </os>
Aug 17 04:18:41 user nova-compute[72793]:   <features>
Aug 17 04:18:41 user nova-compute[72793]:     <acpi/>
Aug 17 04:18:41 user nova-compute[72793]:     <apic/>
Aug 17 04:18:41 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:18:41 user nova-compute[72793]:   </features>
Aug 17 04:18:41 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:18:41 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:18:41 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:18:41 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:18:41 user nova-compute[72793]:   </clock>
Aug 17 04:18:41 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:18:41 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:18:41 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:18:41 user nova-compute[72793]:   </cpu>
Aug 17 04:18:41 user nova-compute[72793]:   <devices>
Aug 17 04:18:41 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:18:41 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:18:41 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk"/>
Aug 17 04:18:41 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:18:41 user nova-compute[72793]:     </disk>
Aug 17 04:18:41 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:18:41 user nova-compute[72793]:       <mac address="fa:16:3e:52:b6:c2"/>
Aug 17 04:18:41 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:18:41 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:18:41 user nova-compute[72793]:       <target dev="tap3390ae2c-95"/>
Aug 17 04:18:41 user nova-compute[72793]:     </interface>
Aug 17 04:18:41 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:18:41 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/console.log" append="off"/>
Aug 17 04:18:41 user nova-compute[72793]:     </serial>
Aug 17 04:18:41 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:18:41 user nova-compute[72793]:     <video>
Aug 17 04:18:41 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:18:41 user nova-compute[72793]:     </video>
Aug 17 04:18:41 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:18:41 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:18:41 user nova-compute[72793]:     </rng>
Aug 17 04:18:41 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:18:41 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:18:41 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:18:41 user nova-compute[72793]:     </memballoon>
Aug 17 04:18:41 user nova-compute[72793]:   </devices>
Aug 17 04:18:41 user nova-compute[72793]: </domain>
Aug 17 04:18:41 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1695440738',display_name='tempest-AttachVolumeNegativeTest-server-1695440738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1695440738',id=39,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNva2kTToWZPgVohPtoYrknjlBYzOI4urpAl87eLPWOO3HdUOAIOQsfnyq4yCP9EwpRbg9hm1cCoj409E3skHeUTM8H7Mx05EpsAGYwUcz4fWp02MtgFKW2e/r2oE15hA==',key_name='tempest-keypair-168073618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-773lruh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG os_vif [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3390ae2c-95, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3390ae2c-95, col_values=(('external_ids', {'iface-id': '3390ae2c-9541-4a17-bed3-7ae67a97404d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:b6:c2', 'vm-uuid': '4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:41 user nova-compute[72793]: INFO os_vif [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95')
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:52:b6:c2, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updated VIF entry in instance network info cache for port 3390ae2c-9541-4a17-bed3-7ae67a97404d. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updating instance_info_cache with network_info: [{"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5b08b72e-a0dc-4270-9715-0af80c7927c3 req-f8889238-19fd-47b7-9bb4-82404df399f2 service nova] Releasing lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:18:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-35b53f0d-8b96-4bd4-8118-16b7e3d0b2e3 req-a7c92803-aa92-497f-8636-d5c3d8e1e731 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-35b53f0d-8b96-4bd4-8118-16b7e3d0b2e3 req-a7c92803-aa92-497f-8636-d5c3d8e1e731 service nova] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-35b53f0d-8b96-4bd4-8118-16b7e3d0b2e3 req-a7c92803-aa92-497f-8636-d5c3d8e1e731 service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-35b53f0d-8b96-4bd4-8118-16b7e3d0b2e3 req-a7c92803-aa92-497f-8636-d5c3d8e1e731 service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-35b53f0d-8b96-4bd4-8118-16b7e3d0b2e3 req-a7c92803-aa92-497f-8636-d5c3d8e1e731 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] No waiting events found dispatching network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:43 user nova-compute[72793]: WARNING nova.compute.manager [req-35b53f0d-8b96-4bd4-8118-16b7e3d0b2e3 req-a7c92803-aa92-497f-8636-d5c3d8e1e731 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received unexpected event network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d for instance with vm_state building and task_state spawning.
Aug 17 04:18:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245924.9297078, 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] VM Resumed (Lifecycle Event)
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:18:44 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Instance spawned successfully.
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:18:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:18:44 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692245924.9312565, 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:44 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] VM Started (Lifecycle Event)
Aug 17 04:18:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:18:45 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:18:45 user nova-compute[72793]: INFO nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 17 04:18:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-f1b1ac59-7fb7-44b7-bace-4216ef9839fc req-281587a8-5ba3-4c40-a367-ac69cdfd5733 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f1b1ac59-7fb7-44b7-bace-4216ef9839fc req-281587a8-5ba3-4c40-a367-ac69cdfd5733 service nova] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f1b1ac59-7fb7-44b7-bace-4216ef9839fc req-281587a8-5ba3-4c40-a367-ac69cdfd5733 service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f1b1ac59-7fb7-44b7-bace-4216ef9839fc req-281587a8-5ba3-4c40-a367-ac69cdfd5733 service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-f1b1ac59-7fb7-44b7-bace-4216ef9839fc req-281587a8-5ba3-4c40-a367-ac69cdfd5733 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] No waiting events found dispatching network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:45 user nova-compute[72793]: WARNING nova.compute.manager [req-f1b1ac59-7fb7-44b7-bace-4216ef9839fc req-281587a8-5ba3-4c40-a367-ac69cdfd5733 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received unexpected event network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d for instance with vm_state building and task_state spawning.
Aug 17 04:18:45 user nova-compute[72793]: INFO nova.compute.manager [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Took 6.22 seconds to build instance.
Aug 17 04:18:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4c3033ba-069e-407c-94e1-5f7c28080178 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.318s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:46 user nova-compute[72793]: INFO nova.compute.manager [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Terminating instance
Aug 17 04:18:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Instance destroyed successfully.
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'resources' on Instance uuid 3492c76f-a8cc-4db3-b2a8-6b661597d0ef {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1716769912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1716769912',id=34,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-ka52pvdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:17:00Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=3492c76f-a8cc-4db3-b2a8-6b661597d0ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "address": "fa:16:3e:6b:7a:ae", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc9ec6ec-fc", "ovs_interfaceid": "cc9ec6ec-fc04-4a98-a2fa-1dce988ba746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_vif [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc9ec6ec-fc, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:18:47 user nova-compute[72793]: INFO os_vif [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:ae,bridge_name='br-int',has_traffic_filtering=True,id=cc9ec6ec-fc04-4a98-a2fa-1dce988ba746,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc9ec6ec-fc')
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrURuXpe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:18:47 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfa3f8a-71f8-4e71-ae9e-47d7755d586b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:47 user nova-compute[72793]: WARNING nova.compute.manager [req-6894829f-c0c6-4609-900a-4d2f3621213c req-0c34e9d9-25ec-4ce5-af03-8b458704baef service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state active and task_state deleting.
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad535390-4921-4003-a0c1-3bd5543ead44]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:18:47 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:18:47 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:18:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:18:47 user nova-compute[72793]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 (non-flash)
Aug 17 04:18:47 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:18:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98ace5e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49'): ({'sdd'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Removing single pathed devices sdd {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8945021-5716-468c-8e4d-f8914cc00e6d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f20a460-e173-400e-9acb-7667e1096bd3]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flushing IO for device /dev/sdd {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9669b816-cd4f-4a3d-9aa5-799a6c05900c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd622a0-5383-4026-8bcd-edd1008c0978]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173f941-430b-481a-81b9-b178af6fcb9f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --logout" returned: 0 in 0.168s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[246218fd-a4b3-407f-a310-1ab98693d603]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260]
Aug 17 04:18:47 user nova-compute[72793]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49, portal: 172.16.0.220,3260] successful.
Aug 17 04:18:47 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99b584d9-49e0-4b88-b15e-3c62260abe49 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bea85a-850c-48f0-b406-2a2165237fe7]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== disconnect_volume: return (486ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:18:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Deleting instance files /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef_del
Aug 17 04:18:47 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Deletion of /opt/stack/data/nova/instances/3492c76f-a8cc-4db3-b2a8-6b661597d0ef_del complete
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:47 user nova-compute[72793]: INFO nova.compute.manager [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 17 04:18:47 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:18:47 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:18:48 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:18:48 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Took 0.51 seconds to deallocate network for instance.
Aug 17 04:18:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-60a5bf3a-371d-4daf-a065-debb5ee68b87 req-ea9068d6-f51c-47f3-95ff-e88cf8b1d636 service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-deleted-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:49 user nova-compute[72793]: INFO nova.compute.manager [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Took 0.85 seconds to detach 1 volumes for instance.
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:49 user nova-compute[72793]: WARNING nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state deleted and task_state None.
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:49 user nova-compute[72793]: WARNING nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state deleted and task_state None.
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:49 user nova-compute[72793]: WARNING nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-unplugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state deleted and task_state None.
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Acquiring lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] No waiting events found dispatching network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:18:49 user nova-compute[72793]: WARNING nova.compute.manager [req-14a7a92d-174d-4a87-aaf8-d7924c8944b8 req-aaf716cc-b320-4675-b07f-ae6c88cb049d service nova] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Received unexpected event network-vif-plugged-cc9ec6ec-fc04-4a98-a2fa-1dce988ba746 for instance with vm_state deleted and task_state None.
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:49 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Deleted allocations for instance 3492c76f-a8cc-4db3-b2a8-6b661597d0ef
Aug 17 04:18:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-873f4033-59b2-4672-8085-f08aca25e562 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "3492c76f-a8cc-4db3-b2a8-6b661597d0ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.315s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:18:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:52 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245917.4025905, 103e1896-9e0f-4533-9c10-a9eb2dca5012 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:18:52 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] VM Stopped (Lifecycle Event)
Aug 17 04:18:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dcafe898-e96e-405d-a89a-ccb58baa2048 None None] [instance: 103e1896-9e0f-4533-9c10-a9eb2dca5012] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:18:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:18:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:02 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245927.0197675, 3492c76f-a8cc-4db3-b2a8-6b661597d0ef => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:19:02 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] VM Stopped (Lifecycle Event)
Aug 17 04:19:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c35de24-d44f-458b-a208-344049733290 None None] [instance: 3492c76f-a8cc-4db3-b2a8-6b661597d0ef] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:19:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:19:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:19:21 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:19:21 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=24.89698028564453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 5324b34b-1ce3-41c7-b3f3-47156e936a33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6d28a716-02d3-4311-b625-c15e13a95b9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:19:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:19:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [{"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-fc597951-d11b-4e35-8ee5-1f35c14c37eb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:19:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:19:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:19:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:19:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:19:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:19:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:37 user nova-compute[72793]: INFO nova.compute.manager [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Terminating instance
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-66ec26aa-ed51-431b-aed8-235d66dfef43 req-c63ac19a-160e-45da-a115-292d3f8bb07f service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-vif-unplugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-66ec26aa-ed51-431b-aed8-235d66dfef43 req-c63ac19a-160e-45da-a115-292d3f8bb07f service nova] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-66ec26aa-ed51-431b-aed8-235d66dfef43 req-c63ac19a-160e-45da-a115-292d3f8bb07f service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-66ec26aa-ed51-431b-aed8-235d66dfef43 req-c63ac19a-160e-45da-a115-292d3f8bb07f service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-66ec26aa-ed51-431b-aed8-235d66dfef43 req-c63ac19a-160e-45da-a115-292d3f8bb07f service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] No waiting events found dispatching network-vif-unplugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.compute.manager [req-66ec26aa-ed51-431b-aed8-235d66dfef43 req-c63ac19a-160e-45da-a115-292d3f8bb07f service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-vif-unplugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:19:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Instance destroyed successfully.
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'resources' on Instance uuid 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:10:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1794108197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1794108197',id=30,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:10:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-af9qutcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:12:11Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=4b3b5660-7dfb-41a3-a5da-fe7f7862a61d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "address": "fa:16:3e:f0:01:66", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb801eece-ac", "ovs_interfaceid": "b801eece-ac6d-4542-acfa-7cc59a20fd6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG os_vif [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb801eece-ac, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:19:37 user nova-compute[72793]: INFO os_vif [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:01:66,bridge_name='br-int',has_traffic_filtering=True,id=b801eece-ac6d-4542-acfa-7cc59a20fd6b,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb801eece-ac')
Aug 17 04:19:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Deleting instance files /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d_del
Aug 17 04:19:37 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Deletion of /opt/stack/data/nova/instances/4b3b5660-7dfb-41a3-a5da-fe7f7862a61d_del complete
Aug 17 04:19:37 user nova-compute[72793]: INFO nova.compute.manager [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 04:19:37 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:19:37 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:19:38 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:19:38 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Took 0.47 seconds to deallocate network for instance.
Aug 17 04:19:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:19:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:19:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:38 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Deleted allocations for instance 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d
Aug 17 04:19:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ffd89213-4494-4cd8-90fe-658c93d980f2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] Acquiring lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] Lock "4b3b5660-7dfb-41a3-a5da-fe7f7862a61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] No waiting events found dispatching network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:19:39 user nova-compute[72793]: WARNING nova.compute.manager [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received unexpected event network-vif-plugged-b801eece-ac6d-4542-acfa-7cc59a20fd6b for instance with vm_state deleted and task_state None.
Aug 17 04:19:39 user nova-compute[72793]: DEBUG nova.compute.manager [req-de510319-8b7d-4768-8847-0191dd211cfd req-f65563c2-94c2-457e-a93f-7fdbf88121bf service nova] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Received event network-vif-deleted-b801eece-ac6d-4542-acfa-7cc59a20fd6b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-changed-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Refreshing instance network info cache due to event network-changed-4823d2d4-0910-44e5-921b-e81019dede34. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] Acquiring lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] Acquired lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG nova.network.neutron [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Refreshing network info cache for port 4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:40 user nova-compute[72793]: INFO nova.compute.manager [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Terminating instance
Aug 17 04:19:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:19:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-5036d3bc-240d-4e35-8003-2638f8a70ee6 req-a7d6a2cd-f623-4b70-96c6-9ace9206c438 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-vif-unplugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5036d3bc-240d-4e35-8003-2638f8a70ee6 req-a7d6a2cd-f623-4b70-96c6-9ace9206c438 service nova] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5036d3bc-240d-4e35-8003-2638f8a70ee6 req-a7d6a2cd-f623-4b70-96c6-9ace9206c438 service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5036d3bc-240d-4e35-8003-2638f8a70ee6 req-a7d6a2cd-f623-4b70-96c6-9ace9206c438 service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-5036d3bc-240d-4e35-8003-2638f8a70ee6 req-a7d6a2cd-f623-4b70-96c6-9ace9206c438 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] No waiting events found dispatching network-vif-unplugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-5036d3bc-240d-4e35-8003-2638f8a70ee6 req-a7d6a2cd-f623-4b70-96c6-9ace9206c438 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-vif-unplugged-4823d2d4-0910-44e5-921b-e81019dede34 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updated VIF entry in instance network info cache for port 4823d2d4-0910-44e5-921b-e81019dede34. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.network.neutron [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updating instance_info_cache with network_info: [{"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-954cdc5a-0472-4dda-ae98-644eceeee5b4 req-11dc0824-d281-45de-95cc-09c21b261922 service nova] Releasing lock "refresh_cache-5324b34b-1ce3-41c7-b3f3-47156e936a33" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:19:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Instance destroyed successfully.
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lazy-loading 'resources' on Instance uuid 5324b34b-1ce3-41c7-b3f3-47156e936a33 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-486250876',display_name='tempest-TestStampPattern-server-486250876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-486250876',id=32,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqB9t/3sSVxFk9/g96xP3rSFx0LEd2VPNOmRyPR0ztCb9JD+Im4SIlqAcSlRg4TJTgiGLSOyiJ+Bqo6d7fO59SFjP1HSGL8I2vjXUN6yYYLnoGGfgGlKAbcF/3Sh8woWw==',key_name='tempest-TestStampPattern-408149894',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d5df793fe4f43b6aa166ea78757d6c5',ramdisk_id='',reservation_id='r-6g7pvmv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-174584011',owner_user_name='tempest-TestStampPattern-174584011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:15:34Z,user_data=None,user_id='ec6ad70b73a9436387c6d5812b30d1f5',uuid=5324b34b-1ce3-41c7-b3f3-47156e936a33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converting VIF {"id": "4823d2d4-0910-44e5-921b-e81019dede34", "address": "fa:16:3e:cd:92:33", "network": {"id": "f3090a57-60fc-45ee-9f2d-c5672f7e156e", "bridge": "br-int", "label": "tempest-TestStampPattern-2012805039-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d5df793fe4f43b6aa166ea78757d6c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4823d2d4-09", "ovs_interfaceid": "4823d2d4-0910-44e5-921b-e81019dede34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG os_vif [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4823d2d4-09, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:19:41 user nova-compute[72793]: INFO os_vif [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:92:33,bridge_name='br-int',has_traffic_filtering=True,id=4823d2d4-0910-44e5-921b-e81019dede34,network=Network(f3090a57-60fc-45ee-9f2d-c5672f7e156e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4823d2d4-09')
Aug 17 04:19:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Deleting instance files /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33_del
Aug 17 04:19:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Deletion of /opt/stack/data/nova/instances/5324b34b-1ce3-41c7-b3f3-47156e936a33_del complete
Aug 17 04:19:41 user nova-compute[72793]: INFO nova.compute.manager [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 04:19:41 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:19:41 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:19:42 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:19:42 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Took 0.57 seconds to deallocate network for instance.
Aug 17 04:19:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-a8517e47-0e1e-4f7e-a6b0-3f6826e743f7 req-9642a2a1-1a81-4062-a3a1-9f0b6638474f service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-vif-deleted-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:42 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:19:42 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:19:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:42 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Deleted allocations for instance 5324b34b-1ce3-41c7-b3f3-47156e936a33
Aug 17 04:19:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1d12e75c-7f37-4200-ab28-f9fc3a871cf8 tempest-TestStampPattern-174584011 tempest-TestStampPattern-174584011-project-member] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-fb296f92-e234-44cc-a4c3-b13afb0fd283 req-e60eca8c-c288-42cc-ac1a-73a0a871794e service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received event network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fb296f92-e234-44cc-a4c3-b13afb0fd283 req-e60eca8c-c288-42cc-ac1a-73a0a871794e service nova] Acquiring lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fb296f92-e234-44cc-a4c3-b13afb0fd283 req-e60eca8c-c288-42cc-ac1a-73a0a871794e service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fb296f92-e234-44cc-a4c3-b13afb0fd283 req-e60eca8c-c288-42cc-ac1a-73a0a871794e service nova] Lock "5324b34b-1ce3-41c7-b3f3-47156e936a33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-fb296f92-e234-44cc-a4c3-b13afb0fd283 req-e60eca8c-c288-42cc-ac1a-73a0a871794e service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] No waiting events found dispatching network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:19:43 user nova-compute[72793]: WARNING nova.compute.manager [req-fb296f92-e234-44cc-a4c3-b13afb0fd283 req-e60eca8c-c288-42cc-ac1a-73a0a871794e service nova] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Received unexpected event network-vif-plugged-4823d2d4-0910-44e5-921b-e81019dede34 for instance with vm_state deleted and task_state None.
Aug 17 04:19:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing instance network info cache due to event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:19:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:19:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:19:48 user nova-compute[72793]: DEBUG nova.network.neutron [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.network.neutron [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updated VIF entry in instance network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.network.neutron [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f9047374-f2b8-4476-90df-b2a881fc7b47 req-eac8a3f1-b262-400a-b7f8-cb4b935bb098 service nova] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:19:49 user nova-compute[72793]: INFO nova.compute.manager [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Detaching volume 3af25ad6-8bce-482a-b735-4298515edfc1
Aug 17 04:19:49 user nova-compute[72793]: INFO nova.virt.block_device [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Attempting to driver detach volume 3af25ad6-8bce-482a-b735-4298515edfc1 from mountpoint /dev/vdb
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Attempting to detach device vdb from instance dae77365-0f83-4512-ac59-c2ca7c692feb from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:19:49 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:19:49 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:19:49 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:19:49 user nova-compute[72793]:   <serial>3af25ad6-8bce-482a-b735-4298515edfc1</serial>
Aug 17 04:19:49 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:19:49 user nova-compute[72793]: </disk>
Aug 17 04:19:49 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:19:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully detached device vdb from instance dae77365-0f83-4512-ac59-c2ca7c692feb from the persistent domain config.
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dae77365-0f83-4512-ac59-c2ca7c692feb from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:19:49 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:19:49 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:19:49 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:19:49 user nova-compute[72793]:   <serial>3af25ad6-8bce-482a-b735-4298515edfc1</serial>
Aug 17 04:19:49 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:19:49 user nova-compute[72793]: </disk>
Aug 17 04:19:49 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692245989.6292472, dae77365-0f83-4512-ac59-c2ca7c692feb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:19:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully detached device vdb from instance dae77365-0f83-4512-ac59-c2ca7c692feb from the live domain config.
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViZFeORW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:19:49 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8e29ed-b9ef-436a-8d6f-1f547810840d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9721d1-0805-4889-9626-6ef2cf56528e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:19:49 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:19:49 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:19:49 user nova-compute[72793]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 (non-flash)
Aug 17 04:19:49 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02dcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc99aa-5480-4f57-bf23-71c760037397]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[58575f02-d323-4be3-8192-f5b459d4f646]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce893bb-fa07-4cbe-8482-2275697ba609]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c37f8bc-0c0f-4360-86cc-3bd91fe3f34f]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4404865-334c-4497-a0c6-d4c79ce617c9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5346cef2-32b6-4b66-a250-e6987965a745]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260]
Aug 17 04:19:49 user nova-compute[72793]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1, portal: 172.16.0.220,3260] successful.
Aug 17 04:19:49 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3af25ad6-8bce-482a-b735-4298515edfc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[99023b99-4e6e-42ab-b690-4e6c4fce50aa]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] <== disconnect_volume: return (306ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:19:49 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG nova.compute.manager [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing instance network info cache due to event network-changed-c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] Acquiring lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] Acquired lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG nova.network.neutron [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Refreshing network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG nova.objects.instance [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'flavor' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-d0ef5f28-4888-41bb-ae89-dec89d6961e5 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:19:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updated VIF entry in instance network info cache for port c588567c-caae-4c85-ad06-93a5e0d96cc2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:19:51 user nova-compute[72793]: DEBUG nova.network.neutron [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [{"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:19:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-77bc0e21-d1e4-45fb-ab42-4e3d9869ecfa req-5b908e7f-0a7f-4a08-b130-0ee665db54ce service nova] Releasing lock "refresh_cache-dae77365-0f83-4512-ac59-c2ca7c692feb" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:19:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:19:52 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245977.7693183, 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:19:52 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] VM Stopped (Lifecycle Event)
Aug 17 04:19:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f61fc549-fddd-4968-ad65-1261fa7a7e5c None None] [instance: 4b3b5660-7dfb-41a3-a5da-fe7f7862a61d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:19:56 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692245981.6792204, 5324b34b-1ce3-41c7-b3f3-47156e936a33 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:19:56 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] VM Stopped (Lifecycle Event)
Aug 17 04:19:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a061400d-b70b-472c-b7ba-a9f0d26d8518 None None] [instance: 5324b34b-1ce3-41c7-b3f3-47156e936a33] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:19:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:16 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:20:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:20:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.146381378173828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d3b38fd0-f823-4a39-927a-52c064339731 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance dae77365-0f83-4512-ac59-c2ca7c692feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6d28a716-02d3-4311-b625-c15e13a95b9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:20:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:20:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:20:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:20:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:20:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updating instance_info_cache with network_info: [{"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-4491ef6b-8f7c-4360-bb15-448dd2959a99" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "d3b38fd0-f823-4a39-927a-52c064339731" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:27 user nova-compute[72793]: INFO nova.compute.manager [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Terminating instance
Aug 17 04:20:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-6bd41bed-441e-408e-8b7b-86893533ca2a req-7b65586f-7d1d-4e49-9da3-026fca1396e3 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6bd41bed-441e-408e-8b7b-86893533ca2a req-7b65586f-7d1d-4e49-9da3-026fca1396e3 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6bd41bed-441e-408e-8b7b-86893533ca2a req-7b65586f-7d1d-4e49-9da3-026fca1396e3 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6bd41bed-441e-408e-8b7b-86893533ca2a req-7b65586f-7d1d-4e49-9da3-026fca1396e3 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-6bd41bed-441e-408e-8b7b-86893533ca2a req-7b65586f-7d1d-4e49-9da3-026fca1396e3 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-6bd41bed-441e-408e-8b7b-86893533ca2a req-7b65586f-7d1d-4e49-9da3-026fca1396e3 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-unplugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:20:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Instance destroyed successfully.
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'resources' on Instance uuid d3b38fd0-f823-4a39-927a-52c064339731 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1652282228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1652282228',id=21,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-dw1fyjjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:08:26Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=d3b38fd0-f823-4a39-927a-52c064339731,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "address": "fa:16:3e:7d:d0:9c", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d296636-08", "ovs_interfaceid": "1d296636-0862-4eb8-b813-29eeba5b6cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_vif [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d296636-08, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:20:28 user nova-compute[72793]: INFO os_vif [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d0:9c,bridge_name='br-int',has_traffic_filtering=True,id=1d296636-0862-4eb8-b813-29eeba5b6cd5,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d296636-08')
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpMrbDmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:20:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20d547-c0d0-4e90-b3fa-9d6af23eb100]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6967983-20da-41f3-837d-1fb040d4881a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:20:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac (non-flash)
Aug 17 04:20:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d051f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac'): ({'sdi'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Removing single pathed devices sdi {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[553854bf-c57c-4a2b-b930-0a2b08ae1961]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b1922-f89f-4571-972b-25812bbb1b85]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Flushing IO for device /dev/sdi {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[35334f7e-a40b-486f-aeb8-e6cce6b8edc8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b3c8be-b6a1-409b-a51e-98f5ed296779]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] SCSI volumes sdi have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4feaf22-8137-49c0-b178-4df560117110]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1afaee-f455-4f46-9a96-40f8069dee67]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260]
Aug 17 04:20:28 user nova-compute[72793]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac, portal: 172.16.0.220,3260] successful.
Aug 17 04:20:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:946c2324-0195-43b5-a447-a0daf9fd48ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc3f488-b674-44b0-98f3-b14620ec3cd4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] <== disconnect_volume: return (293ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:20:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Deleting instance files /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731_del
Aug 17 04:20:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Deletion of /opt/stack/data/nova/instances/d3b38fd0-f823-4a39-927a-52c064339731_del complete
Aug 17 04:20:28 user nova-compute[72793]: INFO nova.compute.manager [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 04:20:28 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:20:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:29 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:29 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Took 0.58 seconds to deallocate network for instance.
Aug 17 04:20:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-baed03a2-251d-43cc-b8e4-044bb5830c5f req-ceb56c06-4f92-48c9-bd6a-16b139232ff8 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-deleted-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:29 user nova-compute[72793]: INFO nova.compute.manager [req-baed03a2-251d-43cc-b8e4-044bb5830c5f req-ceb56c06-4f92-48c9-bd6a-16b139232ff8 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Neutron deleted interface 1d296636-0862-4eb8-b813-29eeba5b6cd5; detaching it from the instance and deleting it from the info cache
Aug 17 04:20:29 user nova-compute[72793]: DEBUG nova.network.neutron [req-baed03a2-251d-43cc-b8e4-044bb5830c5f req-ceb56c06-4f92-48c9-bd6a-16b139232ff8 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-baed03a2-251d-43cc-b8e4-044bb5830c5f req-ceb56c06-4f92-48c9-bd6a-16b139232ff8 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Detach interface failed, port_id=1d296636-0862-4eb8-b813-29eeba5b6cd5, reason: Instance d3b38fd0-f823-4a39-927a-52c064339731 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: INFO nova.compute.manager [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 04:20:30 user nova-compute[72793]: INFO nova.compute.manager [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Terminating instance
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:30 user nova-compute[72793]: WARNING nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state deleted and task_state None.
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:30 user nova-compute[72793]: WARNING nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state deleted and task_state None.
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:30 user nova-compute[72793]: WARNING nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state deleted and task_state None.
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Acquiring lock "d3b38fd0-f823-4a39-927a-52c064339731-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] Lock "d3b38fd0-f823-4a39-927a-52c064339731-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] No waiting events found dispatching network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:30 user nova-compute[72793]: WARNING nova.compute.manager [req-cd67c99f-bb74-4850-b8e9-afc261a3904b req-bd7f2be5-29e1-432d-8197-07a3957652b6 service nova] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Received unexpected event network-vif-plugged-1d296636-0862-4eb8-b813-29eeba5b6cd5 for instance with vm_state deleted and task_state None.
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-changed-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.manager [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Refreshing instance network info cache due to event network-changed-3390ae2c-9541-4a17-bed3-7ae67a97404d. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] Acquiring lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] Acquired lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.network.neutron [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Refreshing network info cache for port 3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Deleted allocations for instance d3b38fd0-f823-4a39-927a-52c064339731
Aug 17 04:20:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e2eaa1fa-fe36-47d7-b89c-d6283a31daf9 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "d3b38fd0-f823-4a39-927a-52c064339731" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.100s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Instance destroyed successfully.
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lazy-loading 'resources' on Instance uuid 6d28a716-02d3-4311-b625-c15e13a95b9d {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-235334498',display_name='tempest-VolumesActionsTest-instance-235334498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-235334498',id=38,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed7012002c5470791e96bc238218fa8',ramdisk_id='',reservation_id='r-ppvn0j9c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-467590366',owner_user_name='tempest-VolumesActionsTest-467590366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:18:34Z,user_data=None,user_id='20e14d27758f4d06ada663158d4a86e7',uuid=6d28a716-02d3-4311-b625-c15e13a95b9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Converting VIF {"id": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "address": "fa:16:3e:f6:be:bb", "network": {"id": "fa359c21-9f4b-4872-936a-a33451b2303a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2145803214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed7012002c5470791e96bc238218fa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b7049-90", "ovs_interfaceid": "f88b7049-9018-4b9f-9ccf-90ac58ffe7df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG os_vif [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf88b7049-90, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:20:31 user nova-compute[72793]: INFO os_vif [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:be:bb,bridge_name='br-int',has_traffic_filtering=True,id=f88b7049-9018-4b9f-9ccf-90ac58ffe7df,network=Network(fa359c21-9f4b-4872-936a-a33451b2303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b7049-90')
Aug 17 04:20:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Deleting instance files /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d_del
Aug 17 04:20:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Deletion of /opt/stack/data/nova/instances/6d28a716-02d3-4311-b625-c15e13a95b9d_del complete
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: INFO nova.compute.manager [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 04:20:31 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.network.neutron [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updated VIF entry in instance network info cache for port 3390ae2c-9541-4a17-bed3-7ae67a97404d. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG nova.network.neutron [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updating instance_info_cache with network_info: [{"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-63b5fe9d-2668-422f-9e00-773dd923f6bd req-1769b473-2945-4c21-ba9a-17c95ae57d14 service nova] Releasing lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:32 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Took 1.02 seconds to deallocate network for instance.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-4150cde3-2cff-43e4-a1ed-9b5f88a65a52 req-101cb446-0cbb-46c5-9f0c-d0e03b523fa1 service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-deleted-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-unplugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-unplugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-unplugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state deleted and task_state None.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state deleted and task_state None.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state deleted and task_state None.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state deleted and task_state None.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-unplugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-unplugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-unplugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state deleted and task_state None.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Acquiring lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] No waiting events found dispatching network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:32 user nova-compute[72793]: WARNING nova.compute.manager [req-3c25305f-c968-4d27-86e1-c6622ebcd673 req-1858bd92-6f24-4a31-8a59-e1614a303f1d service nova] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Received unexpected event network-vif-plugged-f88b7049-9018-4b9f-9ccf-90ac58ffe7df for instance with vm_state deleted and task_state None.
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:32 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Deleted allocations for instance 6d28a716-02d3-4311-b625-c15e13a95b9d
Aug 17 04:20:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7e6cae8c-05ec-44c4-b81d-63310d109c95 tempest-VolumesActionsTest-467590366 tempest-VolumesActionsTest-467590366-project-member] Lock "6d28a716-02d3-4311-b625-c15e13a95b9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.593s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG nova.objects.instance [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:35 user nova-compute[72793]: INFO nova.compute.manager [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Attaching volume af9e3c3b-953b-41cb-b45f-a1ff435ac13c to /dev/vdb
Aug 17 04:20:35 user nova-compute[72793]: DEBUG os_brick.utils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4688cbd-caad-45cc-aba3-ddd1e76b52ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248d30c-8271-4547-90e0-49a1743da5df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[453914e3-8f9d-465b-b01b-970d5acc9fa0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615431e-f8fe-4120-9133-0eb9f11396ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:20:35 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:20:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e944fbbb-86d8-43b3-8e3f-52d1a71a8ec4]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG os_brick.utils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updating existing volume attachment record: 2113eb56-7ed6-44da-9771-c4fd56be547e {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:20:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:39 user nova-compute[72793]: INFO nova.compute.manager [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Terminating instance
Aug 17 04:20:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-67f049bb-181c-4c34-9cc1-3cf29b84f871 req-559b616d-52e0-42c7-86b2-bd7f1262b80f service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-67f049bb-181c-4c34-9cc1-3cf29b84f871 req-559b616d-52e0-42c7-86b2-bd7f1262b80f service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-67f049bb-181c-4c34-9cc1-3cf29b84f871 req-559b616d-52e0-42c7-86b2-bd7f1262b80f service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-67f049bb-181c-4c34-9cc1-3cf29b84f871 req-559b616d-52e0-42c7-86b2-bd7f1262b80f service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-67f049bb-181c-4c34-9cc1-3cf29b84f871 req-559b616d-52e0-42c7-86b2-bd7f1262b80f service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.compute.manager [req-67f049bb-181c-4c34-9cc1-3cf29b84f871 req-559b616d-52e0-42c7-86b2-bd7f1262b80f service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-unplugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:20:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Instance destroyed successfully.
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'resources' on Instance uuid dae77365-0f83-4512-ac59-c2ca7c692feb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:13:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271896945',display_name='tempest-ServerRescueNegativeTestJSON-server-271896945',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271896945',id=35,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiLjDybp3SvYmN4ApaLN5ioF/eAWa6/TR6dUNnPRndQ43CBfOx0HSmh12VLhFv1WfC5t9zurBh+QaEf7xccvL4nsh9PozlS2vnzP4tWnSFinoQGQVCUZ/Nhnyoqg8mLvg==',key_name='tempest-keypair-1142879458',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-n0ekpjwx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=dae77365-0f83-4512-ac59-c2ca7c692feb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "address": "fa:16:3e:01:4b:3f", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc588567c-ca", "ovs_interfaceid": "c588567c-caae-4c85-ad06-93a5e0d96cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG os_vif [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc588567c-ca, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:20:40 user nova-compute[72793]: INFO os_vif [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:4b:3f,bridge_name='br-int',has_traffic_filtering=True,id=c588567c-caae-4c85-ad06-93a5e0d96cc2,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc588567c-ca')
Aug 17 04:20:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Deleting instance files /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb_del
Aug 17 04:20:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Deletion of /opt/stack/data/nova/instances/dae77365-0f83-4512-ac59-c2ca7c692feb_del complete
Aug 17 04:20:40 user nova-compute[72793]: INFO nova.compute.manager [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 04:20:40 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:20:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-e3b63981-8524-4989-a1e5-13418c918791 req-ec8d6ff8-b141-4896-8832-42bd63925edf service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e3b63981-8524-4989-a1e5-13418c918791 req-ec8d6ff8-b141-4896-8832-42bd63925edf service nova] Acquiring lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e3b63981-8524-4989-a1e5-13418c918791 req-ec8d6ff8-b141-4896-8832-42bd63925edf service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e3b63981-8524-4989-a1e5-13418c918791 req-ec8d6ff8-b141-4896-8832-42bd63925edf service nova] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-e3b63981-8524-4989-a1e5-13418c918791 req-ec8d6ff8-b141-4896-8832-42bd63925edf service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] No waiting events found dispatching network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:42 user nova-compute[72793]: WARNING nova.compute.manager [req-e3b63981-8524-4989-a1e5-13418c918791 req-ec8d6ff8-b141-4896-8832-42bd63925edf service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received unexpected event network-vif-plugged-c588567c-caae-4c85-ad06-93a5e0d96cc2 for instance with vm_state active and task_state deleting.
Aug 17 04:20:42 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:42 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Took 2.64 seconds to deallocate network for instance.
Aug 17 04:20:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:43 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:20:43 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:20:43 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246028.3552659, d3b38fd0-f823-4a39-927a-52c064339731 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:20:43 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d3b38fd0-f823-4a39-927a-52c064339731] VM Stopped (Lifecycle Event)
Aug 17 04:20:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4508780c-ef80-4c03-bd55-8bce955ea984 None None] [instance: d3b38fd0-f823-4a39-927a-52c064339731] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:20:43 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Deleted allocations for instance dae77365-0f83-4512-ac59-c2ca7c692feb
Aug 17 04:20:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-521b4901-b334-4df5-8636-7b2a3031bc2d tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "dae77365-0f83-4512-ac59-c2ca7c692feb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.011s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-07b0626f-6370-4ab7-a21d-eb45c6ccc01d req-3b994b39-645e-42b1-afd7-78ebcec1bbc0 service nova] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Received event network-vif-deleted-c588567c-caae-4c85-ad06-93a5e0d96cc2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246030.9973202, 6d28a716-02d3-4311-b625-c15e13a95b9d => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:20:46 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] VM Stopped (Lifecycle Event)
Aug 17 04:20:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-04e07067-1ecd-41d7-8056-d91977f4dd01 None None] [instance: 6d28a716-02d3-4311-b625-c15e13a95b9d] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpvDKUjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:20:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:20:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:20:46 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5abf4-ecaf-423d-a4ce-1d444f9120a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:20:46 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe95aef-50fc-43e0-bdc1-1f3ad2f33e3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c] added
Aug 17 04:20:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[46de1115-53e4-439f-aa76-608d558594fb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb045785-d640-4fd9-ae87-0b36ec3fc212]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpvDKUjC {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpvDKUjC" returned: 0 in 0.032s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb5fe6-8899-4e81-ab07-c56ac5c7a157]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tpvDKUjC'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2056b1ee-f77c-4cd3-8f43-f0b05f3ca6ad]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[212ff07e-d703-468e-a46a-b20feac1aef8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:20:46 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:20:46 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:20:46 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:20:46 user nova-compute[72793]: 
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f9ea6-1803-4f31-9c7c-948fbfb0be05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260]
Aug 17 04:20:46 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260] successful.
Aug 17 04:20:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f6dc3-e7b0-4c10-a4d1-31b8ab07976b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de4ea4f-bdaa-45af-a280-792892007961]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c (non-flash)
Aug 17 04:20:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c (non-flash)
Aug 17 04:20:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950ef21-2fbe-45e5-9665-872431a58f8c]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:20:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpvDKUjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26532386332383761', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532386332383761', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:20:47 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:20:47 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:20:47 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:20:47 user nova-compute[72793]:   <serial>af9e3c3b-953b-41cb-b45f-a1ff435ac13c</serial>
Aug 17 04:20:47 user nova-compute[72793]: </disk>
Aug 17 04:20:47 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:20:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:20:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:20:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:52:b6:c2, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:20:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df84f510-f648-462d-ac8c-7070c07d0f06 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.653s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:20:51 user nova-compute[72793]: INFO nova.compute.claims [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Claim successful on node user
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:20:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.policy [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621ab8c1ef2c4af2a0baf1390a22ff56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12975ec6f4e740808d9bdd0be12181e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:20:51 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Creating image(s)
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:51 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk 1073741824" returned: 0 in 0.051s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Successfully created port: d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Cannot resize image /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'migration_context' on Instance uuid 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Ensure instance console log exists: /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Successfully updated port: d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquired lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-changed-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Refreshing instance network info cache due to event network-changed-d20d2e77-3127-4e95-a2fc-3199426924a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] Acquiring lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updating instance_info_cache with network_info: [{"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Releasing lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Instance network_info: |[{"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] Acquired lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Refreshing network info cache for port d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Start _get_guest_xml network_info=[{"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:20:53 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:20:53 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1778015445',display_name='tempest-AttachVolumeNegativeTest-server-1778015445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1778015445',id=40,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUhrYA54N9DIbSeloNyyqp/lRlhO/3dhec1klDQMhbR1UY1aNz+dWNQ3OqFimjjCw9+3LZPQ3u5Fwi7In6T8z/2MG2x1jaSo6cg8kWbxdO8VzHXlvhE5R82qdU55Ej0sA==',key_name='tempest-keypair-522607837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-6ccfkgcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:20:53 user nova-compute[72793]:   <uuid>9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8</uuid>
Aug 17 04:20:53 user nova-compute[72793]:   <name>instance-00000028</name>
Aug 17 04:20:53 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:20:53 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:20:53 user nova-compute[72793]:   <metadata>
Aug 17 04:20:53 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:20:53 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:20:53 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1778015445</nova:name>
Aug 17 04:20:53 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:20:53</nova:creationTime>
Aug 17 04:20:53 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:20:53 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:20:53 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:20:53 user nova-compute[72793]:       <nova:owner>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:user uuid="621ab8c1ef2c4af2a0baf1390a22ff56">tempest-AttachVolumeNegativeTest-1865038023-project-member</nova:user>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:project uuid="12975ec6f4e740808d9bdd0be12181e7">tempest-AttachVolumeNegativeTest-1865038023</nova:project>
Aug 17 04:20:53 user nova-compute[72793]:       </nova:owner>
Aug 17 04:20:53 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:20:53 user nova-compute[72793]:       <nova:ports>
Aug 17 04:20:53 user nova-compute[72793]:         <nova:port uuid="d20d2e77-3127-4e95-a2fc-3199426924a7">
Aug 17 04:20:53 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:20:53 user nova-compute[72793]:         </nova:port>
Aug 17 04:20:53 user nova-compute[72793]:       </nova:ports>
Aug 17 04:20:53 user nova-compute[72793]:     </nova:instance>
Aug 17 04:20:53 user nova-compute[72793]:   </metadata>
Aug 17 04:20:53 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:20:53 user nova-compute[72793]:     <system>
Aug 17 04:20:53 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:20:53 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:20:53 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:20:53 user nova-compute[72793]:       <entry name="serial">9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8</entry>
Aug 17 04:20:53 user nova-compute[72793]:       <entry name="uuid">9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8</entry>
Aug 17 04:20:53 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:20:53 user nova-compute[72793]:     </system>
Aug 17 04:20:53 user nova-compute[72793]:   </sysinfo>
Aug 17 04:20:53 user nova-compute[72793]:   <os>
Aug 17 04:20:53 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:20:53 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:20:53 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:20:53 user nova-compute[72793]:   </os>
Aug 17 04:20:53 user nova-compute[72793]:   <features>
Aug 17 04:20:53 user nova-compute[72793]:     <acpi/>
Aug 17 04:20:53 user nova-compute[72793]:     <apic/>
Aug 17 04:20:53 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:20:53 user nova-compute[72793]:   </features>
Aug 17 04:20:53 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:20:53 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:20:53 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:20:53 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:20:53 user nova-compute[72793]:   </clock>
Aug 17 04:20:53 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:20:53 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:20:53 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:20:53 user nova-compute[72793]:   </cpu>
Aug 17 04:20:53 user nova-compute[72793]:   <devices>
Aug 17 04:20:53 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:20:53 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:20:53 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk"/>
Aug 17 04:20:53 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:20:53 user nova-compute[72793]:     </disk>
Aug 17 04:20:53 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:20:53 user nova-compute[72793]:       <mac address="fa:16:3e:8a:40:eb"/>
Aug 17 04:20:53 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:20:53 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:20:53 user nova-compute[72793]:       <target dev="tapd20d2e77-31"/>
Aug 17 04:20:53 user nova-compute[72793]:     </interface>
Aug 17 04:20:53 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:20:53 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/console.log" append="off"/>
Aug 17 04:20:53 user nova-compute[72793]:     </serial>
Aug 17 04:20:53 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:20:53 user nova-compute[72793]:     <video>
Aug 17 04:20:53 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:20:53 user nova-compute[72793]:     </video>
Aug 17 04:20:53 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:20:53 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:20:53 user nova-compute[72793]:     </rng>
Aug 17 04:20:53 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:20:53 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:20:53 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:20:53 user nova-compute[72793]:     </memballoon>
Aug 17 04:20:53 user nova-compute[72793]:   </devices>
Aug 17 04:20:53 user nova-compute[72793]: </domain>
Aug 17 04:20:53 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1778015445',display_name='tempest-AttachVolumeNegativeTest-server-1778015445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1778015445',id=40,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUhrYA54N9DIbSeloNyyqp/lRlhO/3dhec1klDQMhbR1UY1aNz+dWNQ3OqFimjjCw9+3LZPQ3u5Fwi7In6T8z/2MG2x1jaSo6cg8kWbxdO8VzHXlvhE5R82qdU55Ej0sA==',key_name='tempest-keypair-522607837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-6ccfkgcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG os_vif [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd20d2e77-31, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd20d2e77-31, col_values=(('external_ids', {'iface-id': 'd20d2e77-3127-4e95-a2fc-3199426924a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:40:eb', 'vm-uuid': '9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:53 user nova-compute[72793]: INFO os_vif [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31')
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:8a:40:eb, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updated VIF entry in instance network info cache for port d20d2e77-3127-4e95-a2fc-3199426924a7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updating instance_info_cache with network_info: [{"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:20:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d4f34e90-6696-405e-89f7-09e44b71585d req-910934bf-d08c-4621-b237-6f122748b271 service nova] Releasing lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-28d6e470-0112-42ec-a5d3-8144c0c9b36e req-4f1326ba-7da5-43fe-b28c-35acf2ce8063 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-28d6e470-0112-42ec-a5d3-8144c0c9b36e req-4f1326ba-7da5-43fe-b28c-35acf2ce8063 service nova] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-28d6e470-0112-42ec-a5d3-8144c0c9b36e req-4f1326ba-7da5-43fe-b28c-35acf2ce8063 service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-28d6e470-0112-42ec-a5d3-8144c0c9b36e req-4f1326ba-7da5-43fe-b28c-35acf2ce8063 service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-28d6e470-0112-42ec-a5d3-8144c0c9b36e req-4f1326ba-7da5-43fe-b28c-35acf2ce8063 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] No waiting events found dispatching network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:54 user nova-compute[72793]: WARNING nova.compute.manager [req-28d6e470-0112-42ec-a5d3-8144c0c9b36e req-4f1326ba-7da5-43fe-b28c-35acf2ce8063 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received unexpected event network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 for instance with vm_state building and task_state spawning.
Aug 17 04:20:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:55 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246040.257322, dae77365-0f83-4512-ac59-c2ca7c692feb => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:20:55 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] VM Stopped (Lifecycle Event)
Aug 17 04:20:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-540ece65-59bd-4de6-825f-d9726b24310c None None] [instance: dae77365-0f83-4512-ac59-c2ca7c692feb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:20:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246056.9507399, 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:20:56 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] VM Resumed (Lifecycle Event)
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:20:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Instance spawned successfully.
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:20:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:20:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-9b645cf6-a28f-4e9f-ae8a-b25126a8bef9 req-0dcaa4e6-5015-4e2c-a467-9c37fbfae6f9 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:20:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9b645cf6-a28f-4e9f-ae8a-b25126a8bef9 req-0dcaa4e6-5015-4e2c-a467-9c37fbfae6f9 service nova] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:20:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9b645cf6-a28f-4e9f-ae8a-b25126a8bef9 req-0dcaa4e6-5015-4e2c-a467-9c37fbfae6f9 service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:20:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-9b645cf6-a28f-4e9f-ae8a-b25126a8bef9 req-0dcaa4e6-5015-4e2c-a467-9c37fbfae6f9 service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-9b645cf6-a28f-4e9f-ae8a-b25126a8bef9 req-0dcaa4e6-5015-4e2c-a467-9c37fbfae6f9 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] No waiting events found dispatching network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:20:57 user nova-compute[72793]: WARNING nova.compute.manager [req-9b645cf6-a28f-4e9f-ae8a-b25126a8bef9 req-0dcaa4e6-5015-4e2c-a467-9c37fbfae6f9 service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received unexpected event network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 for instance with vm_state building and task_state spawning.
Aug 17 04:20:57 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:20:57 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246056.954025, 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:20:57 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] VM Started (Lifecycle Event)
Aug 17 04:20:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:20:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:20:57 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:20:57 user nova-compute[72793]: INFO nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 17 04:20:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:20:57 user nova-compute[72793]: INFO nova.compute.manager [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Took 6.03 seconds to build instance.
Aug 17 04:20:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ac481696-71bb-47cb-9cc8-41fe3648b245 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.118s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:20:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:21:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:21:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:21:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:21:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:16 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:18 user nova-compute[72793]: INFO nova.compute.manager [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Terminating instance
Aug 17 04:21:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-2d067406-8f8c-48b2-82df-aa10b89d28c7 req-3cc12b51-6ecc-4938-b74f-52a0142cc6be service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-vif-unplugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2d067406-8f8c-48b2-82df-aa10b89d28c7 req-3cc12b51-6ecc-4938-b74f-52a0142cc6be service nova] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2d067406-8f8c-48b2-82df-aa10b89d28c7 req-3cc12b51-6ecc-4938-b74f-52a0142cc6be service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2d067406-8f8c-48b2-82df-aa10b89d28c7 req-3cc12b51-6ecc-4938-b74f-52a0142cc6be service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-2d067406-8f8c-48b2-82df-aa10b89d28c7 req-3cc12b51-6ecc-4938-b74f-52a0142cc6be service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] No waiting events found dispatching network-vif-unplugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG nova.compute.manager [req-2d067406-8f8c-48b2-82df-aa10b89d28c7 req-3cc12b51-6ecc-4938-b74f-52a0142cc6be service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-vif-unplugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Instance destroyed successfully.
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lazy-loading 'resources' on Instance uuid 210d0b74-53d8-45d4-b4b4-691c18fc125b {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1070304473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1070304473',id=16,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:01:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1ec39bbf61f45c6963f018159dcb33c',ramdisk_id='',reservation_id='r-bi36ep3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:03:36Z,user_data=None,user_id='21663e2118004c528a64a7fba2e29ee3',uuid=210d0b74-53d8-45d4-b4b4-691c18fc125b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converting VIF {"id": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "address": "fa:16:3e:5f:f8:c5", "network": {"id": "a0a3a29b-a26c-4eff-83da-eaa6b5b97e10", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-669188075-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1ec39bbf61f45c6963f018159dcb33c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap665a8716-2a", "ovs_interfaceid": "665a8716-2a2e-4c84-b345-21a1c4e3b65d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG os_vif [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap665a8716-2a, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:21:19 user nova-compute[72793]: INFO os_vif [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f8:c5,bridge_name='br-int',has_traffic_filtering=True,id=665a8716-2a2e-4c84-b345-21a1c4e3b65d,network=Network(a0a3a29b-a26c-4eff-83da-eaa6b5b97e10),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap665a8716-2a')
Aug 17 04:21:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Deleting instance files /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b_del
Aug 17 04:21:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Deletion of /opt/stack/data/nova/instances/210d0b74-53d8-45d4-b4b4-691c18fc125b_del complete
Aug 17 04:21:19 user nova-compute[72793]: INFO nova.compute.manager [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid '210d0b74-53d8-45d4-b4b4-691c18fc125b' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid '210d0b74-53d8-45d4-b4b4-691c18fc125b' (instance-00000010)
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:21:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:21:19 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:21:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8022MB free_disk=25.164260864257812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 210d0b74-53d8-45d4-b4b4-691c18fc125b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4491ef6b-8f7c-4360-bb15-448dd2959a99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance ef52ab14-abca-42c8-8266-204444ede656 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:21:20 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Took 0.98 seconds to deallocate network for instance.
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.136s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:20 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Deleted allocations for instance 210d0b74-53d8-45d4-b4b4-691c18fc125b
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2f9a0894-98d9-43ad-911e-8f60fc62ade2 tempest-ServerBootFromVolumeStableRescueTest-1752371327 tempest-ServerBootFromVolumeStableRescueTest-1752371327-project-member] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] Acquiring lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] Lock "210d0b74-53d8-45d4-b4b4-691c18fc125b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] No waiting events found dispatching network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:21:20 user nova-compute[72793]: WARNING nova.compute.manager [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received unexpected event network-vif-plugged-665a8716-2a2e-4c84-b345-21a1c4e3b65d for instance with vm_state deleted and task_state None.
Aug 17 04:21:20 user nova-compute[72793]: DEBUG nova.compute.manager [req-1920121f-3e0b-453f-9ab7-bfdd163454f5 req-ff423468-432b-471e-8082-341baead9a7d service nova] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Received event network-vif-deleted-665a8716-2a2e-4c84-b345-21a1c4e3b65d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:21:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Updating instance_info_cache with network_info: [{"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-ef52ab14-abca-42c8-8266-204444ede656" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:21:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:34 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246079.0092888, 210d0b74-53d8-45d4-b4b4-691c18fc125b => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:21:34 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] VM Stopped (Lifecycle Event)
Aug 17 04:21:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fa77afbd-4688-4632-9283-c84132582cad None None] [instance: 210d0b74-53d8-45d4-b4b4-691c18fc125b] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:21:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "ef52ab14-abca-42c8-8266-204444ede656" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:35 user nova-compute[72793]: INFO nova.compute.manager [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Terminating instance
Aug 17 04:21:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea0e2307-55df-41c7-bee6-37805725e249 req-ada1b1e4-22b9-4510-8bb1-1199cc10b958 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-vif-unplugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea0e2307-55df-41c7-bee6-37805725e249 req-ada1b1e4-22b9-4510-8bb1-1199cc10b958 service nova] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea0e2307-55df-41c7-bee6-37805725e249 req-ada1b1e4-22b9-4510-8bb1-1199cc10b958 service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ea0e2307-55df-41c7-bee6-37805725e249 req-ada1b1e4-22b9-4510-8bb1-1199cc10b958 service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea0e2307-55df-41c7-bee6-37805725e249 req-ada1b1e4-22b9-4510-8bb1-1199cc10b958 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] No waiting events found dispatching network-vif-unplugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-ea0e2307-55df-41c7-bee6-37805725e249 req-ada1b1e4-22b9-4510-8bb1-1199cc10b958 service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-vif-unplugged-71833219-beb7-41f4-87da-78b2de88b10b for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] Instance destroyed successfully.
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lazy-loading 'resources' on Instance uuid ef52ab14-abca-42c8-8266-204444ede656 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-791223120',display_name='tempest-ServersNegativeTestJSON-server-791223120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-791223120',id=33,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ff1feab57f4390be7855b073d7c634',ramdisk_id='',reservation_id='r-7oeylftw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-698989669',owner_user_name='tempest-ServersNegativeTestJSON-698989669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:12:47Z,user_data=None,user_id='ad60fa5186024d2e8c03a99d8b90834a',uuid=ef52ab14-abca-42c8-8266-204444ede656,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converting VIF {"id": "71833219-beb7-41f4-87da-78b2de88b10b", "address": "fa:16:3e:71:f0:05", "network": {"id": "08080411-d780-4657-b19f-ce13992c7392", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1262804536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ff1feab57f4390be7855b073d7c634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71833219-be", "ovs_interfaceid": "71833219-beb7-41f4-87da-78b2de88b10b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG os_vif [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71833219-be, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:21:36 user nova-compute[72793]: INFO os_vif [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:f0:05,bridge_name='br-int',has_traffic_filtering=True,id=71833219-beb7-41f4-87da-78b2de88b10b,network=Network(08080411-d780-4657-b19f-ce13992c7392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71833219-be')
Aug 17 04:21:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Deleting instance files /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656_del
Aug 17 04:21:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Deletion of /opt/stack/data/nova/instances/ef52ab14-abca-42c8-8266-204444ede656_del complete
Aug 17 04:21:36 user nova-compute[72793]: INFO nova.compute.manager [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] [instance: ef52ab14-abca-42c8-8266-204444ede656] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 17 04:21:36 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:21:36 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:21:37 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:21:37 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] Took 0.54 seconds to deallocate network for instance.
Aug 17 04:21:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:37 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:21:37 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:21:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:37 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Deleted allocations for instance ef52ab14-abca-42c8-8266-204444ede656
Aug 17 04:21:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2c9c630e-ef67-41e3-a2d2-309ddcc1e7fa tempest-ServersNegativeTestJSON-698989669 tempest-ServersNegativeTestJSON-698989669-project-member] Lock "ef52ab14-abca-42c8-8266-204444ede656" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.698s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] Acquiring lock "ef52ab14-abca-42c8-8266-204444ede656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] Lock "ef52ab14-abca-42c8-8266-204444ede656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] No waiting events found dispatching network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:21:38 user nova-compute[72793]: WARNING nova.compute.manager [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received unexpected event network-vif-plugged-71833219-beb7-41f4-87da-78b2de88b10b for instance with vm_state deleted and task_state None.
Aug 17 04:21:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-db48e1e7-0c28-48f5-a1f2-6bf02c8ec43c req-dab922bc-0fd4-44a0-b5bc-eb945ae3299f service nova] [instance: ef52ab14-abca-42c8-8266-204444ede656] Received event network-vif-deleted-71833219-beb7-41f4-87da-78b2de88b10b {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:45 user nova-compute[72793]: INFO nova.compute.manager [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Terminating instance
Aug 17 04:21:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-179f3f33-6a0c-4da5-b612-feec595d9f06 req-32d029ff-98b8-436a-84e1-48a3eb7a9d8a service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-unplugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-179f3f33-6a0c-4da5-b612-feec595d9f06 req-32d029ff-98b8-436a-84e1-48a3eb7a9d8a service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-179f3f33-6a0c-4da5-b612-feec595d9f06 req-32d029ff-98b8-436a-84e1-48a3eb7a9d8a service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-179f3f33-6a0c-4da5-b612-feec595d9f06 req-32d029ff-98b8-436a-84e1-48a3eb7a9d8a service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-179f3f33-6a0c-4da5-b612-feec595d9f06 req-32d029ff-98b8-436a-84e1-48a3eb7a9d8a service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-unplugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG nova.compute.manager [req-179f3f33-6a0c-4da5-b612-feec595d9f06 req-32d029ff-98b8-436a-84e1-48a3eb7a9d8a service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-unplugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Instance destroyed successfully.
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'resources' on Instance uuid 4491ef6b-8f7c-4360-bb15-448dd2959a99 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1885957072',display_name='tempest-ServerRescueNegativeTestJSON-server-1885957072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1885957072',id=24,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-8p7zlh0a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:07:14Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=4491ef6b-8f7c-4360-bb15-448dd2959a99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "4c4b5504-d88a-4921-8899-4c689002bd0d", "address": "fa:16:3e:e3:86:44", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c4b5504-d8", "ovs_interfaceid": "4c4b5504-d88a-4921-8899-4c689002bd0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG os_vif [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c4b5504-d8, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:21:46 user nova-compute[72793]: INFO os_vif [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:86:44,bridge_name='br-int',has_traffic_filtering=True,id=4c4b5504-d88a-4921-8899-4c689002bd0d,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c4b5504-d8')
Aug 17 04:21:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Deleting instance files /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99_del
Aug 17 04:21:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Deletion of /opt/stack/data/nova/instances/4491ef6b-8f7c-4360-bb15-448dd2959a99_del complete
Aug 17 04:21:46 user nova-compute[72793]: INFO nova.compute.manager [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 04:21:46 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:21:46 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Took 0.52 seconds to deallocate network for instance.
Aug 17 04:21:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:21:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:46 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Deleted allocations for instance 4491ef6b-8f7c-4360-bb15-448dd2959a99
Aug 17 04:21:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c449ea93-475f-4fa3-90e0-17ea93d9d425 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.777s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] Acquiring lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:21:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:21:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] Lock "4491ef6b-8f7c-4360-bb15-448dd2959a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:21:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] No waiting events found dispatching network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:21:47 user nova-compute[72793]: WARNING nova.compute.manager [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received unexpected event network-vif-plugged-4c4b5504-d88a-4921-8899-4c689002bd0d for instance with vm_state deleted and task_state None.
Aug 17 04:21:47 user nova-compute[72793]: DEBUG nova.compute.manager [req-a95a4b7f-3280-4990-ba69-f02b1df031ec req-edcafd7b-cbf0-4323-b447-da92a26da2c1 service nova] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Received event network-vif-deleted-4c4b5504-d88a-4921-8899-4c689002bd0d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:21:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:51 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246096.3477948, ef52ab14-abca-42c8-8266-204444ede656 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:21:51 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: ef52ab14-abca-42c8-8266-204444ede656] VM Stopped (Lifecycle Event)
Aug 17 04:21:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7da99069-4b67-4a08-91c8-e1350235e3b6 None None] [instance: ef52ab14-abca-42c8-8266-204444ede656] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:21:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:21:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:21:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:21:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:21:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:21:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:01 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246106.0322325, 4491ef6b-8f7c-4360-bb15-448dd2959a99 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:22:01 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] VM Stopped (Lifecycle Event)
Aug 17 04:22:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9ed668d8-eb19-4160-859a-d526e44c6b2a None None] [instance: 4491ef6b-8f7c-4360-bb15-448dd2959a99] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:22:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:22:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:16 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:22:17 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:22:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:22:18 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=25.341529846191406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance fc597951-d11b-4e35-8ee5-1f35c14c37eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:22:18 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:22:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:22:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:22:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:22:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:22:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:22:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:22:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:22:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:35 user nova-compute[72793]: INFO nova.compute.manager [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Terminating instance
Aug 17 04:22:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-767adaa0-a49c-4ee1-b29b-eed2bdc0b9db req-47ba395f-e48d-4350-a23a-46194d8c1c42 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-767adaa0-a49c-4ee1-b29b-eed2bdc0b9db req-47ba395f-e48d-4350-a23a-46194d8c1c42 service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-767adaa0-a49c-4ee1-b29b-eed2bdc0b9db req-47ba395f-e48d-4350-a23a-46194d8c1c42 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-767adaa0-a49c-4ee1-b29b-eed2bdc0b9db req-47ba395f-e48d-4350-a23a-46194d8c1c42 service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-767adaa0-a49c-4ee1-b29b-eed2bdc0b9db req-47ba395f-e48d-4350-a23a-46194d8c1c42 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-767adaa0-a49c-4ee1-b29b-eed2bdc0b9db req-47ba395f-e48d-4350-a23a-46194d8c1c42 service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-unplugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:22:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Instance destroyed successfully.
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.objects.instance [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lazy-loading 'resources' on Instance uuid fc597951-d11b-4e35-8ee5-1f35c14c37eb {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-126366052',display_name='tempest-ServerRescueNegativeTestJSON-server-126366052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-126366052',id=23,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:10:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fba66a3ba645414983fd9fa888e734c9',ramdisk_id='',reservation_id='r-vbayucpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1617582959',owner_user_name='tempest-ServerRescueNegativeTestJSON-1617582959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:12:00Z,user_data=None,user_id='cbad450f600b4d0aac294be4cd145fa5',uuid=fc597951-d11b-4e35-8ee5-1f35c14c37eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converting VIF {"id": "1c674004-09d6-41ac-8e81-57fbc1c33254", "address": "fa:16:3e:5c:37:bd", "network": {"id": "8da682c9-f488-4423-a8ba-af934c0361de", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-673993564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fba66a3ba645414983fd9fa888e734c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c674004-09", "ovs_interfaceid": "1c674004-09d6-41ac-8e81-57fbc1c33254", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG os_vif [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c674004-09, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:22:36 user nova-compute[72793]: INFO os_vif [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:37:bd,bridge_name='br-int',has_traffic_filtering=True,id=1c674004-09d6-41ac-8e81-57fbc1c33254,network=Network(8da682c9-f488-4423-a8ba-af934c0361de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c674004-09')
Aug 17 04:22:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Deleting instance files /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb_del
Aug 17 04:22:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Deletion of /opt/stack/data/nova/instances/fc597951-d11b-4e35-8ee5-1f35c14c37eb_del complete
Aug 17 04:22:36 user nova-compute[72793]: INFO nova.compute.manager [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 04:22:36 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:22:36 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:22:37 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:22:37 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Took 0.67 seconds to deallocate network for instance.
Aug 17 04:22:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:37 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:22:37 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:22:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:37 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Deleted allocations for instance fc597951-d11b-4e35-8ee5-1f35c14c37eb
Aug 17 04:22:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-76545aae-8a53-499c-ab78-9ac8f43d7282 tempest-ServerRescueNegativeTestJSON-1617582959 tempest-ServerRescueNegativeTestJSON-1617582959-project-member] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] Acquiring lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] Lock "fc597951-d11b-4e35-8ee5-1f35c14c37eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] No waiting events found dispatching network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:22:38 user nova-compute[72793]: WARNING nova.compute.manager [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received unexpected event network-vif-plugged-1c674004-09d6-41ac-8e81-57fbc1c33254 for instance with vm_state deleted and task_state None.
Aug 17 04:22:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-4a0d53a1-5333-49b7-899b-fef56c83aa02 req-b39353bd-805d-4d8b-8948-a2d4322d9e2d service nova] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Received event network-vif-deleted-1c674004-09d6-41ac-8e81-57fbc1c33254 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-changed-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Refreshing instance network info cache due to event network-changed-d20d2e77-3127-4e95-a2fc-3199426924a7. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] Acquiring lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] Acquired lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG nova.network.neutron [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Refreshing network info cache for port d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:42 user nova-compute[72793]: INFO nova.compute.manager [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Terminating instance
Aug 17 04:22:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updated VIF entry in instance network info cache for port d20d2e77-3127-4e95-a2fc-3199426924a7. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updating instance_info_cache with network_info: [{"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-60d9a82c-64dd-4ea1-8bc7-948000e6865a req-50488370-590f-4ce5-aa00-836a641f7e5b service nova] Releasing lock "refresh_cache-9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:43 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Instance destroyed successfully.
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.objects.instance [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'resources' on Instance uuid 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1778015445',display_name='tempest-AttachVolumeNegativeTest-server-1778015445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1778015445',id=40,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUhrYA54N9DIbSeloNyyqp/lRlhO/3dhec1klDQMhbR1UY1aNz+dWNQ3OqFimjjCw9+3LZPQ3u5Fwi7In6T8z/2MG2x1jaSo6cg8kWbxdO8VzHXlvhE5R82qdU55Ej0sA==',key_name='tempest-keypair-522607837',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:20:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-6ccfkgcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "d20d2e77-3127-4e95-a2fc-3199426924a7", "address": "fa:16:3e:8a:40:eb", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd20d2e77-31", "ovs_interfaceid": "d20d2e77-3127-4e95-a2fc-3199426924a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG os_vif [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd20d2e77-31, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:22:43 user nova-compute[72793]: INFO os_vif [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:40:eb,bridge_name='br-int',has_traffic_filtering=True,id=d20d2e77-3127-4e95-a2fc-3199426924a7,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd20d2e77-31')
Aug 17 04:22:43 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Deleting instance files /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8_del
Aug 17 04:22:43 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Deletion of /opt/stack/data/nova/instances/9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8_del complete
Aug 17 04:22:43 user nova-compute[72793]: INFO nova.compute.manager [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 04:22:43 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:22:43 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-vif-unplugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] No waiting events found dispatching network-vif-unplugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-vif-unplugged-d20d2e77-3127-4e95-a2fc-3199426924a7 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] Acquiring lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] No waiting events found dispatching network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:22:44 user nova-compute[72793]: WARNING nova.compute.manager [req-05cf85f9-7271-40f9-af15-1c6fcd9fe182 req-ff22aad5-f4b5-4f64-84a2-5cad40e571ac service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received unexpected event network-vif-plugged-d20d2e77-3127-4e95-a2fc-3199426924a7 for instance with vm_state active and task_state deleting.
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:22:44 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Took 0.90 seconds to deallocate network for instance.
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-f8d7299d-4e3f-4f17-842b-7ce47f362a96 req-d379edc4-efed-4bb4-8814-3c9fb0233a1a service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Received event network-vif-deleted-d20d2e77-3127-4e95-a2fc-3199426924a7 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:22:44 user nova-compute[72793]: INFO nova.compute.manager [req-f8d7299d-4e3f-4f17-842b-7ce47f362a96 req-d379edc4-efed-4bb4-8814-3c9fb0233a1a service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Neutron deleted interface d20d2e77-3127-4e95-a2fc-3199426924a7; detaching it from the instance and deleting it from the info cache
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-f8d7299d-4e3f-4f17-842b-7ce47f362a96 req-d379edc4-efed-4bb4-8814-3c9fb0233a1a service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-f8d7299d-4e3f-4f17-842b-7ce47f362a96 req-d379edc4-efed-4bb4-8814-3c9fb0233a1a service nova] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Detach interface failed, port_id=d20d2e77-3127-4e95-a2fc-3199426924a7, reason: Instance 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:44 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Deleted allocations for instance 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8
Aug 17 04:22:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-9fa1dca7-0951-43a2-87c6-9b8a2bfa5b15 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:22:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:51 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246156.4686685, fc597951-d11b-4e35-8ee5-1f35c14c37eb => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:22:51 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] VM Stopped (Lifecycle Event)
Aug 17 04:22:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-89c7214f-2b28-45a1-9fdb-afaf7f462c1e None None] [instance: fc597951-d11b-4e35-8ee5-1f35c14c37eb] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:22:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:22:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:22:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:22:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:22:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:58 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246163.5894778, 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:22:58 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] VM Stopped (Lifecycle Event)
Aug 17 04:22:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ad5e9145-2cdb-4f16-a027-2e775d3df6b8 None None] [instance: 9a0247c6-2d5b-40ae-8dd1-a75ccd17dbb8] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:22:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:22:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:23:17 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:17 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:23:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:23:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:23:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=25.377635955810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:23:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:23:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:23:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updating instance_info_cache with network_info: [{"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:34 user nova-compute[72793]: INFO nova.compute.manager [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Detaching volume af9e3c3b-953b-41cb-b45f-a1ff435ac13c
Aug 17 04:23:34 user nova-compute[72793]: INFO nova.virt.block_device [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Attempting to driver detach volume af9e3c3b-953b-41cb-b45f-a1ff435ac13c from mountpoint /dev/vdb
Aug 17 04:23:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Attempting to detach device vdb from instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:23:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:23:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:23:34 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:23:34 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:23:34 user nova-compute[72793]:   <serial>af9e3c3b-953b-41cb-b45f-a1ff435ac13c</serial>
Aug 17 04:23:34 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:23:34 user nova-compute[72793]: </disk>
Aug 17 04:23:34 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:23:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully detached device vdb from instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd from the persistent domain config.
Aug 17 04:23:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:23:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:23:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:23:34 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:23:34 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:23:34 user nova-compute[72793]:   <serial>af9e3c3b-953b-41cb-b45f-a1ff435ac13c</serial>
Aug 17 04:23:34 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:23:34 user nova-compute[72793]: </disk>
Aug 17 04:23:34 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692246215.0891576, 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:23:35 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully detached device vdb from instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd from the live domain config.
Aug 17 04:23:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpvDKUjC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:23:35 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5151b4-aa5a-4277-a7b2-b2d12b986977]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3abef5-5f4c-4a5c-8a56-67c0ec781cdb]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c (non-flash)
Aug 17 04:23:35 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c (non-flash)
Aug 17 04:23:35 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f02f2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21d3d7-67df-4bfd-844c-fa1da6562393]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3005dd08-9415-4d70-a84a-b4500766847f]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b472f6a-6cf3-4808-9ec3-de80d2dec129]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040769f-c441-4ff9-a129-86f3060e7994]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ba0ffc-715c-4465-903a-e6a5a21194aa]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b632b040-5ae3-404d-a259-880db78371a6]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260]
Aug 17 04:23:35 user nova-compute[72793]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c, portal: 172.16.0.220,3260] successful.
Aug 17 04:23:35 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af9e3c3b-953b-41cb-b45f-a1ff435ac13c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf21fc-8e85-4f72-bbfb-0b93ad0c29cb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== disconnect_volume: return (284ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:23:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:23:36 user nova-compute[72793]: DEBUG nova.objects.instance [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:23:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-921ac98b-6afe-488d-a8e1-00e0f972fb89 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.966s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:23:40 user nova-compute[72793]: INFO nova.compute.claims [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Claim successful on node user
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:23:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:23:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Creating image(s)
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG nova.policy [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302b737fd798432683e98f2c60b76b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863a28bd4f24493fa848df117d9edac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:23:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk 1073741824" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Successfully created port: 3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Cannot resize image /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'migration_context' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Ensure instance console log exists: /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Successfully updated port: 3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-changed-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Refreshing instance network info cache due to event network-changed-3851205d-1f2c-48b0-b097-b172f3b5ace9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance network_info: |[{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.neutron [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Refreshing network info cache for port 3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start _get_guest_xml network_info=[{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:23:42 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:23:42 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:23:42 user nova-compute[72793]:   <uuid>6a40379d-ca08-4b3e-95f6-61d93d529162</uuid>
Aug 17 04:23:42 user nova-compute[72793]:   <name>instance-00000029</name>
Aug 17 04:23:42 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:23:42 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:23:42 user nova-compute[72793]:   <metadata>
Aug 17 04:23:42 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:23:42 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:23:42 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeTestJSON-server-1580509719</nova:name>
Aug 17 04:23:42 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:23:42</nova:creationTime>
Aug 17 04:23:42 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:23:42 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:23:42 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:23:42 user nova-compute[72793]:       <nova:owner>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:user uuid="302b737fd798432683e98f2c60b76b71">tempest-AttachVolumeTestJSON-769655846-project-member</nova:user>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:project uuid="863a28bd4f24493fa848df117d9edac7">tempest-AttachVolumeTestJSON-769655846</nova:project>
Aug 17 04:23:42 user nova-compute[72793]:       </nova:owner>
Aug 17 04:23:42 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:23:42 user nova-compute[72793]:       <nova:ports>
Aug 17 04:23:42 user nova-compute[72793]:         <nova:port uuid="3851205d-1f2c-48b0-b097-b172f3b5ace9">
Aug 17 04:23:42 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:23:42 user nova-compute[72793]:         </nova:port>
Aug 17 04:23:42 user nova-compute[72793]:       </nova:ports>
Aug 17 04:23:42 user nova-compute[72793]:     </nova:instance>
Aug 17 04:23:42 user nova-compute[72793]:   </metadata>
Aug 17 04:23:42 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:23:42 user nova-compute[72793]:     <system>
Aug 17 04:23:42 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:23:42 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:23:42 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:23:42 user nova-compute[72793]:       <entry name="serial">6a40379d-ca08-4b3e-95f6-61d93d529162</entry>
Aug 17 04:23:42 user nova-compute[72793]:       <entry name="uuid">6a40379d-ca08-4b3e-95f6-61d93d529162</entry>
Aug 17 04:23:42 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:23:42 user nova-compute[72793]:     </system>
Aug 17 04:23:42 user nova-compute[72793]:   </sysinfo>
Aug 17 04:23:42 user nova-compute[72793]:   <os>
Aug 17 04:23:42 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:23:42 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:23:42 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:23:42 user nova-compute[72793]:   </os>
Aug 17 04:23:42 user nova-compute[72793]:   <features>
Aug 17 04:23:42 user nova-compute[72793]:     <acpi/>
Aug 17 04:23:42 user nova-compute[72793]:     <apic/>
Aug 17 04:23:42 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:23:42 user nova-compute[72793]:   </features>
Aug 17 04:23:42 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:23:42 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:23:42 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:23:42 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:23:42 user nova-compute[72793]:   </clock>
Aug 17 04:23:42 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:23:42 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:23:42 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:23:42 user nova-compute[72793]:   </cpu>
Aug 17 04:23:42 user nova-compute[72793]:   <devices>
Aug 17 04:23:42 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:23:42 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:23:42 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk"/>
Aug 17 04:23:42 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:23:42 user nova-compute[72793]:     </disk>
Aug 17 04:23:42 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:23:42 user nova-compute[72793]:       <mac address="fa:16:3e:f5:c0:2d"/>
Aug 17 04:23:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:23:42 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:23:42 user nova-compute[72793]:       <target dev="tap3851205d-1f"/>
Aug 17 04:23:42 user nova-compute[72793]:     </interface>
Aug 17 04:23:42 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:23:42 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/console.log" append="off"/>
Aug 17 04:23:42 user nova-compute[72793]:     </serial>
Aug 17 04:23:42 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:23:42 user nova-compute[72793]:     <video>
Aug 17 04:23:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:23:42 user nova-compute[72793]:     </video>
Aug 17 04:23:42 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:23:42 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:23:42 user nova-compute[72793]:     </rng>
Aug 17 04:23:42 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:23:42 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:23:42 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:23:42 user nova-compute[72793]:     </memballoon>
Aug 17 04:23:42 user nova-compute[72793]:   </devices>
Aug 17 04:23:42 user nova-compute[72793]: </domain>
Aug 17 04:23:42 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG os_vif [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3851205d-1f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3851205d-1f, col_values=(('external_ids', {'iface-id': '3851205d-1f2c-48b0-b097-b172f3b5ace9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:2d', 'vm-uuid': '6a40379d-ca08-4b3e-95f6-61d93d529162'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:23:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:43 user nova-compute[72793]: INFO os_vif [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f')
Aug 17 04:23:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:23:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No VIF found with MAC fa:16:3e:f5:c0:2d, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:23:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated VIF entry in instance network info cache for port 3851205d-1f2c-48b0-b097-b172f3b5ace9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:23:43 user nova-compute[72793]: DEBUG nova.network.neutron [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:23:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2db01c74-2323-45b3-b3c3-ee3f3e35913b req-bf43befd-c957-4801-9592-d4164abb9403 service nova] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-fdaaa7b6-f98c-4031-9ff6-2152a57e9eb3 req-37d6db83-1286-4b5e-b773-478330dc27a5 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaaa7b6-f98c-4031-9ff6-2152a57e9eb3 req-37d6db83-1286-4b5e-b773-478330dc27a5 service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaaa7b6-f98c-4031-9ff6-2152a57e9eb3 req-37d6db83-1286-4b5e-b773-478330dc27a5 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-fdaaa7b6-f98c-4031-9ff6-2152a57e9eb3 req-37d6db83-1286-4b5e-b773-478330dc27a5 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-fdaaa7b6-f98c-4031-9ff6-2152a57e9eb3 req-37d6db83-1286-4b5e-b773-478330dc27a5 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:23:44 user nova-compute[72793]: WARNING nova.compute.manager [req-fdaaa7b6-f98c-4031-9ff6-2152a57e9eb3 req-37d6db83-1286-4b5e-b773-478330dc27a5 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state building and task_state spawning.
Aug 17 04:23:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246226.558544, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Resumed (Lifecycle Event)
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance spawned successfully.
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246226.5607715, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Started (Lifecycle Event)
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-37c474ad-a3ab-41c7-87ce-cf942852d052 req-de4d5820-c75e-4c97-bbac-0d17461de200 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37c474ad-a3ab-41c7-87ce-cf942852d052 req-de4d5820-c75e-4c97-bbac-0d17461de200 service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37c474ad-a3ab-41c7-87ce-cf942852d052 req-de4d5820-c75e-4c97-bbac-0d17461de200 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-37c474ad-a3ab-41c7-87ce-cf942852d052 req-de4d5820-c75e-4c97-bbac-0d17461de200 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-37c474ad-a3ab-41c7-87ce-cf942852d052 req-de4d5820-c75e-4c97-bbac-0d17461de200 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:23:46 user nova-compute[72793]: WARNING nova.compute.manager [req-37c474ad-a3ab-41c7-87ce-cf942852d052 req-de4d5820-c75e-4c97-bbac-0d17461de200 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state building and task_state spawning.
Aug 17 04:23:46 user nova-compute[72793]: INFO nova.compute.manager [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Took 6.50 seconds to build instance.
Aug 17 04:23:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e09aa5e7-15a1-4397-a91e-5094e4718f67 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.592s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:23:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:23:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:23:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:24:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:24:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:24:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:24:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.336807250976562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:24:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:24 user nova-compute[72793]: INFO nova.compute.manager [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Terminating instance
Aug 17 04:24:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-6bf4ab62-982b-488d-a078-61efd5c67804 req-0cd1c0ba-f2cc-472c-b386-065a359f390a service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-vif-unplugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6bf4ab62-982b-488d-a078-61efd5c67804 req-0cd1c0ba-f2cc-472c-b386-065a359f390a service nova] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6bf4ab62-982b-488d-a078-61efd5c67804 req-0cd1c0ba-f2cc-472c-b386-065a359f390a service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6bf4ab62-982b-488d-a078-61efd5c67804 req-0cd1c0ba-f2cc-472c-b386-065a359f390a service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-6bf4ab62-982b-488d-a078-61efd5c67804 req-0cd1c0ba-f2cc-472c-b386-065a359f390a service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] No waiting events found dispatching network-vif-unplugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-6bf4ab62-982b-488d-a078-61efd5c67804 req-0cd1c0ba-f2cc-472c-b386-065a359f390a service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-vif-unplugged-3390ae2c-9541-4a17-bed3-7ae67a97404d for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Instance destroyed successfully.
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'resources' on Instance uuid 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1695440738',display_name='tempest-AttachVolumeNegativeTest-server-1695440738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1695440738',id=39,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNva2kTToWZPgVohPtoYrknjlBYzOI4urpAl87eLPWOO3HdUOAIOQsfnyq4yCP9EwpRbg9hm1cCoj409E3skHeUTM8H7Mx05EpsAGYwUcz4fWp02MtgFKW2e/r2oE15hA==',key_name='tempest-keypair-168073618',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-773lruh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "address": "fa:16:3e:52:b6:c2", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3390ae2c-95", "ovs_interfaceid": "3390ae2c-9541-4a17-bed3-7ae67a97404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG os_vif [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3390ae2c-95, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:24:25 user nova-compute[72793]: INFO os_vif [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b6:c2,bridge_name='br-int',has_traffic_filtering=True,id=3390ae2c-9541-4a17-bed3-7ae67a97404d,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3390ae2c-95')
Aug 17 04:24:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Deleting instance files /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd_del
Aug 17 04:24:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Deletion of /opt/stack/data/nova/instances/4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd_del complete
Aug 17 04:24:25 user nova-compute[72793]: INFO nova.compute.manager [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 04:24:25 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:24:25 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:24:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:24:27 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Took 1.42 seconds to deallocate network for instance.
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-65c8319e-bbe9-46b9-acdf-2c28f0031a09 req-d9245de9-38d3-4b49-94cc-8595531117c2 service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-vif-deleted-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2b3b309-78fa-46b6-83c5-bed518d638c1 req-3bb78142-a9bb-43c6-b1ac-5a9f8d8add0d service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received event network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2b3b309-78fa-46b6-83c5-bed518d638c1 req-3bb78142-a9bb-43c6-b1ac-5a9f8d8add0d service nova] Acquiring lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2b3b309-78fa-46b6-83c5-bed518d638c1 req-3bb78142-a9bb-43c6-b1ac-5a9f8d8add0d service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2b3b309-78fa-46b6-83c5-bed518d638c1 req-3bb78142-a9bb-43c6-b1ac-5a9f8d8add0d service nova] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2b3b309-78fa-46b6-83c5-bed518d638c1 req-3bb78142-a9bb-43c6-b1ac-5a9f8d8add0d service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] No waiting events found dispatching network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:24:27 user nova-compute[72793]: WARNING nova.compute.manager [req-b2b3b309-78fa-46b6-83c5-bed518d638c1 req-3bb78142-a9bb-43c6-b1ac-5a9f8d8add0d service nova] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Received unexpected event network-vif-plugged-3390ae2c-9541-4a17-bed3-7ae67a97404d for instance with vm_state active and task_state deleting.
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:27 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Deleted allocations for instance 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c83420bc-5028-4719-893b-180ce3daf761 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.608s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:24:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:24:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:24:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:40 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246265.6509295, 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:24:40 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] VM Stopped (Lifecycle Event)
Aug 17 04:24:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e7f19a97-0ec0-4322-ab8b-e689107e9e01 None None] [instance: 4ede6eb8-434f-4f5a-8537-4b7e0ebaeecd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:24:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:24:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:24:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:24:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:24:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:24:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:24:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:25:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:25:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:25:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:25:19 user nova-compute[72793]: INFO nova.compute.claims [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Claim successful on node user
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:25:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.policy [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621ab8c1ef2c4af2a0baf1390a22ff56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12975ec6f4e740808d9bdd0be12181e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:25:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Creating image(s)
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "/opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk 1073741824" returned: 0 in 0.048s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.204s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Successfully created port: 4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Cannot resize image /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'migration_context' on Instance uuid d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Ensure instance console log exists: /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:25:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:25:20 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=25.362106323242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Successfully updated port: 4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquired lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-changed-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Refreshing instance network info cache due to event network-changed-4def59df-725e-4421-a4b1-18bd5df66e90. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] Acquiring lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updating instance_info_cache with network_info: [{"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Releasing lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Instance network_info: |[{"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] Acquired lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Refreshing network info cache for port 4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Start _get_guest_xml network_info=[{"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:25:21 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:25:21 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-522226453',display_name='tempest-AttachVolumeNegativeTest-server-522226453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-522226453',id=42,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiIRDJuI2l4x/36Dcb0sanQ3PzlH1LTVnzpdqTaSCuEYaOfW71HU6nvuO11CsaKV2PIfncGxvQkPKk8LdOc6nrYyvg+pLddy/naTryzmdIgke2zqxn8DtzsxvkLEx+I5g==',key_name='tempest-keypair-687654916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-lsxtpy1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=d58613bf-f8c0-4bea-9533-6f3ffd859c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.objects.instance [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'pci_devices' on Instance uuid d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:25:21 user nova-compute[72793]:   <uuid>d58613bf-f8c0-4bea-9533-6f3ffd859c82</uuid>
Aug 17 04:25:21 user nova-compute[72793]:   <name>instance-0000002a</name>
Aug 17 04:25:21 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:25:21 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:25:21 user nova-compute[72793]:   <metadata>
Aug 17 04:25:21 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:25:21 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:25:21 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeNegativeTest-server-522226453</nova:name>
Aug 17 04:25:21 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:25:21</nova:creationTime>
Aug 17 04:25:21 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:25:21 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:25:21 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:25:21 user nova-compute[72793]:       <nova:owner>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:user uuid="621ab8c1ef2c4af2a0baf1390a22ff56">tempest-AttachVolumeNegativeTest-1865038023-project-member</nova:user>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:project uuid="12975ec6f4e740808d9bdd0be12181e7">tempest-AttachVolumeNegativeTest-1865038023</nova:project>
Aug 17 04:25:21 user nova-compute[72793]:       </nova:owner>
Aug 17 04:25:21 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:25:21 user nova-compute[72793]:       <nova:ports>
Aug 17 04:25:21 user nova-compute[72793]:         <nova:port uuid="4def59df-725e-4421-a4b1-18bd5df66e90">
Aug 17 04:25:21 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 04:25:21 user nova-compute[72793]:         </nova:port>
Aug 17 04:25:21 user nova-compute[72793]:       </nova:ports>
Aug 17 04:25:21 user nova-compute[72793]:     </nova:instance>
Aug 17 04:25:21 user nova-compute[72793]:   </metadata>
Aug 17 04:25:21 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:25:21 user nova-compute[72793]:     <system>
Aug 17 04:25:21 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:25:21 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:25:21 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:25:21 user nova-compute[72793]:       <entry name="serial">d58613bf-f8c0-4bea-9533-6f3ffd859c82</entry>
Aug 17 04:25:21 user nova-compute[72793]:       <entry name="uuid">d58613bf-f8c0-4bea-9533-6f3ffd859c82</entry>
Aug 17 04:25:21 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:25:21 user nova-compute[72793]:     </system>
Aug 17 04:25:21 user nova-compute[72793]:   </sysinfo>
Aug 17 04:25:21 user nova-compute[72793]:   <os>
Aug 17 04:25:21 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:25:21 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:25:21 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:25:21 user nova-compute[72793]:   </os>
Aug 17 04:25:21 user nova-compute[72793]:   <features>
Aug 17 04:25:21 user nova-compute[72793]:     <acpi/>
Aug 17 04:25:21 user nova-compute[72793]:     <apic/>
Aug 17 04:25:21 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:25:21 user nova-compute[72793]:   </features>
Aug 17 04:25:21 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:25:21 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:25:21 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:25:21 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:25:21 user nova-compute[72793]:   </clock>
Aug 17 04:25:21 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:25:21 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:25:21 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:25:21 user nova-compute[72793]:   </cpu>
Aug 17 04:25:21 user nova-compute[72793]:   <devices>
Aug 17 04:25:21 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:25:21 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:25:21 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk"/>
Aug 17 04:25:21 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:25:21 user nova-compute[72793]:     </disk>
Aug 17 04:25:21 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:25:21 user nova-compute[72793]:       <mac address="fa:16:3e:f4:ea:3c"/>
Aug 17 04:25:21 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:25:21 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:25:21 user nova-compute[72793]:       <target dev="tap4def59df-72"/>
Aug 17 04:25:21 user nova-compute[72793]:     </interface>
Aug 17 04:25:21 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:25:21 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/console.log" append="off"/>
Aug 17 04:25:21 user nova-compute[72793]:     </serial>
Aug 17 04:25:21 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:25:21 user nova-compute[72793]:     <video>
Aug 17 04:25:21 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:25:21 user nova-compute[72793]:     </video>
Aug 17 04:25:21 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:25:21 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:25:21 user nova-compute[72793]:     </rng>
Aug 17 04:25:21 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:25:21 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:25:21 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:25:21 user nova-compute[72793]:     </memballoon>
Aug 17 04:25:21 user nova-compute[72793]:   </devices>
Aug 17 04:25:21 user nova-compute[72793]: </domain>
Aug 17 04:25:21 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-522226453',display_name='tempest-AttachVolumeNegativeTest-server-522226453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-522226453',id=42,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiIRDJuI2l4x/36Dcb0sanQ3PzlH1LTVnzpdqTaSCuEYaOfW71HU6nvuO11CsaKV2PIfncGxvQkPKk8LdOc6nrYyvg+pLddy/naTryzmdIgke2zqxn8DtzsxvkLEx+I5g==',key_name='tempest-keypair-687654916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-lsxtpy1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:25:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=d58613bf-f8c0-4bea-9533-6f3ffd859c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG os_vif [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4def59df-72, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4def59df-72, col_values=(('external_ids', {'iface-id': '4def59df-725e-4421-a4b1-18bd5df66e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ea:3c', 'vm-uuid': 'd58613bf-f8c0-4bea-9533-6f3ffd859c82'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:21 user nova-compute[72793]: INFO os_vif [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72')
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:f4:ea:3c, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updated VIF entry in instance network info cache for port 4def59df-725e-4421-a4b1-18bd5df66e90. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updating instance_info_cache with network_info: [{"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:25:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-18e2d491-dd47-4e32-9b17-2cb2b05d9a80 req-b814dfb5-ca16-41da-a9aa-e17d781cd1f9 service nova] Releasing lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:25:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6451dc2-0195-4adc-9d15-dfefd4c5b31f req-c7ff1abf-8559-4bb8-818d-f89beb2fe3a4 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6451dc2-0195-4adc-9d15-dfefd4c5b31f req-c7ff1abf-8559-4bb8-818d-f89beb2fe3a4 service nova] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6451dc2-0195-4adc-9d15-dfefd4c5b31f req-c7ff1abf-8559-4bb8-818d-f89beb2fe3a4 service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6451dc2-0195-4adc-9d15-dfefd4c5b31f req-c7ff1abf-8559-4bb8-818d-f89beb2fe3a4 service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6451dc2-0195-4adc-9d15-dfefd4c5b31f req-c7ff1abf-8559-4bb8-818d-f89beb2fe3a4 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] No waiting events found dispatching network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:25:23 user nova-compute[72793]: WARNING nova.compute.manager [req-b6451dc2-0195-4adc-9d15-dfefd4c5b31f req-c7ff1abf-8559-4bb8-818d-f89beb2fe3a4 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received unexpected event network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 for instance with vm_state building and task_state spawning.
Aug 17 04:25:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246324.9547243, d58613bf-f8c0-4bea-9533-6f3ffd859c82 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:25:24 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] VM Resumed (Lifecycle Event)
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:25:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Instance spawned successfully.
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:25:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:25:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246324.9558945, d58613bf-f8c0-4bea-9533-6f3ffd859c82 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:25:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] VM Started (Lifecycle Event)
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:25:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:25:25 user nova-compute[72793]: INFO nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:25:25 user nova-compute[72793]: INFO nova.compute.manager [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Took 6.08 seconds to build instance.
Aug 17 04:25:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-f58f3a70-b079-465d-8739-dd5f60b37afd tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.175s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-bef992de-fdfa-4e96-a510-32e8412cc6db req-4cf2e5e8-7fc8-4539-a44f-5e181f8e082f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bef992de-fdfa-4e96-a510-32e8412cc6db req-4cf2e5e8-7fc8-4539-a44f-5e181f8e082f service nova] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bef992de-fdfa-4e96-a510-32e8412cc6db req-4cf2e5e8-7fc8-4539-a44f-5e181f8e082f service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bef992de-fdfa-4e96-a510-32e8412cc6db req-4cf2e5e8-7fc8-4539-a44f-5e181f8e082f service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-bef992de-fdfa-4e96-a510-32e8412cc6db req-4cf2e5e8-7fc8-4539-a44f-5e181f8e082f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] No waiting events found dispatching network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:25:25 user nova-compute[72793]: WARNING nova.compute.manager [req-bef992de-fdfa-4e96-a510-32e8412cc6db req-4cf2e5e8-7fc8-4539-a44f-5e181f8e082f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received unexpected event network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 for instance with vm_state active and task_state None.
Aug 17 04:25:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:25:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:25:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-changed-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:25:31 user nova-compute[72793]: DEBUG nova.compute.manager [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Refreshing instance network info cache due to event network-changed-3851205d-1f2c-48b0-b097-b172f3b5ace9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:25:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:25:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:25:31 user nova-compute[72793]: DEBUG nova.network.neutron [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Refreshing network info cache for port 3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:25:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated VIF entry in instance network info cache for port 3851205d-1f2c-48b0-b097-b172f3b5ace9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:25:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:25:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-80b173a1-e868-4ad3-bb26-36385d242f78 req-ba864599-599c-4124-8731-9e8295822480 service nova] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:35 user nova-compute[72793]: INFO nova.compute.manager [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Attaching volume c28ff0bc-93fb-42ae-9e73-8b7c61906b8b to /dev/vdb
Aug 17 04:25:35 user nova-compute[72793]: DEBUG os_brick.utils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e42da8-fbe6-4cba-85f7-f5da026dea44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae6490a-00ec-4ebe-8a64-68630be050da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a5e18-6db5-40e2-a03a-b2885e33aeff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e266b95a-edd7-44d3-9d30-3f35236459a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:25:35 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:25:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e160d5e6-6a0e-44a7-8642-3072ee6a9f08]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG os_brick.utils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:25:35 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating existing volume attachment record: 1e689c0e-bf60-43fa-b84e-53fd98666044 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:25:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:25:45 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:25:45 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:25:45 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9efa12e-0168-4880-94f4-f09f759266e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:25:45 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6438dff-06e2-4856-ac3b-04a13897729a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b] added
Aug 17 04:25:45 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a430aa-35dc-4bed-a3df-4ac1bd1a7b5d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2879e9f-7aa6-403c-ba85-7ceb33c3ad09]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPiJyZDd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPiJyZDd" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abcd8a2-bde3-4946-8f35-64a620c5be33]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPiJyZDd'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a114c2-c5b8-4407-beac-67bde24933c7]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5afef44-550c-4044-9f06-07912b17fe50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:25:45 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:25:45 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:25:45 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:25:45 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:25:45 user nova-compute[72793]: 
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03b37b2-4147-4f9f-8db8-2a137decf203]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]
Aug 17 04:25:46 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.
Aug 17 04:25:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69fc916-035e-4e93-b8a8-98a8a5686a40]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e295bf34-cd2e-455f-9f9f-04dc551b2297]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:25:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:25:46 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420ba56-cd66-4f70-88e1-ad7163d36c83]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:25:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23961333763326363', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961333763326363', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:25:47 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:25:47 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:25:47 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:25:47 user nova-compute[72793]:   <serial>c28ff0bc-93fb-42ae-9e73-8b7c61906b8b</serial>
Aug 17 04:25:47 user nova-compute[72793]: </disk>
Aug 17 04:25:47 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No VIF found with MAC fa:16:3e:f5:c0:2d, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:25:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c873c882-493f-42a4-abd9-406d8a91b221 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.938s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72793) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-4b2584f9-05b3-4145-b87c-28944bb05236 req-2fd4f0f6-0a65-414f-a802-235ab53ca5e3 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:25:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4b2584f9-05b3-4145-b87c-28944bb05236 req-2fd4f0f6-0a65-414f-a802-235ab53ca5e3 service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4b2584f9-05b3-4145-b87c-28944bb05236 req-2fd4f0f6-0a65-414f-a802-235ab53ca5e3 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4b2584f9-05b3-4145-b87c-28944bb05236 req-2fd4f0f6-0a65-414f-a802-235ab53ca5e3 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:49 user nova-compute[72793]: DEBUG nova.compute.manager [req-4b2584f9-05b3-4145-b87c-28944bb05236 req-2fd4f0f6-0a65-414f-a802-235ab53ca5e3 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:25:49 user nova-compute[72793]: WARNING nova.compute.manager [req-4b2584f9-05b3-4145-b87c-28944bb05236 req-2fd4f0f6-0a65-414f-a802-235ab53ca5e3 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state active and task_state powering-off.
Aug 17 04:25:49 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance destroyed successfully.
Aug 17 04:25:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:25:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-6164750f-5510-46d3-9b42-7485b0e96607 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.857s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-840d4f44-d36a-4921-9e91-16e4c5016372 req-2f96a745-6de4-4911-a718-1e4e7d229b96 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:25:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-840d4f44-d36a-4921-9e91-16e4c5016372 req-2f96a745-6de4-4911-a718-1e4e7d229b96 service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:25:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-840d4f44-d36a-4921-9e91-16e4c5016372 req-2f96a745-6de4-4911-a718-1e4e7d229b96 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:25:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-840d4f44-d36a-4921-9e91-16e4c5016372 req-2f96a745-6de4-4911-a718-1e4e7d229b96 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:25:51 user nova-compute[72793]: DEBUG nova.compute.manager [req-840d4f44-d36a-4921-9e91-16e4c5016372 req-2f96a745-6de4-4911-a718-1e4e7d229b96 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:25:51 user nova-compute[72793]: WARNING nova.compute.manager [req-840d4f44-d36a-4921-9e91-16e4c5016372 req-2f96a745-6de4-4911-a718-1e4e7d229b96 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state stopped and task_state None.
Aug 17 04:25:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:25:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:04 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246349.5572455, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:26:04 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Stopped (Lifecycle Event)
Aug 17 04:26:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-93031e33-a991-4744-9f8e-34058545a4c0 None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:26:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-93031e33-a991-4744-9f8e-34058545a4c0 None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:26:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:19 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:26:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:26:22 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:26:22 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=25.3323974609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:26:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:26:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:26 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:26:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updating instance_info_cache with network_info: [{"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:26:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:26:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:26:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:26:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-changed-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Refreshing instance network info cache due to event network-changed-4def59df-725e-4421-a4b1-18bd5df66e90. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] Acquiring lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] Acquired lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG nova.network.neutron [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Refreshing network info cache for port 4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG nova.network.neutron [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updated VIF entry in instance network info cache for port 4def59df-725e-4421-a4b1-18bd5df66e90. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG nova.network.neutron [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updating instance_info_cache with network_info: [{"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:27:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a76287a0-de93-418a-bde9-0149dd622b26 req-f3ad2881-4121-402e-9da8-a3477922342f service nova] Releasing lock "refresh_cache-d58613bf-f8c0-4bea-9533-6f3ffd859c82" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:27:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:14 user nova-compute[72793]: DEBUG nova.objects.instance [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:15 user nova-compute[72793]: INFO nova.compute.manager [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Attaching volume 6724e7f6-0828-406c-870d-345c7881791d to /dev/vdb
Aug 17 04:27:15 user nova-compute[72793]: DEBUG os_brick.utils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd7573-d1cf-4e36-b5d8-e66b44c19325]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8e980-0337-4ccc-ad21-da74dc129edd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f5d7e-3c35-4d9a-b47a-fbcc16e0842f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e7e8e-a77f-4d5d-a6ef-872bb17ce23c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:27:15 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:27:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcc0e3f-698d-435d-9469-fc379b3f4abc]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG os_brick.utils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:27:15 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updating existing volume attachment record: eb9793d2-9ec7-4082-9c5c-cb36fc02a0ed {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:27:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:27:22 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:27:22 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8748MB free_disk=25.331588745117188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:27:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:27:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:27:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNgkliFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:27:31 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:27:31 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:27:31 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007d3f5-61be-47d6-8472-9485c39fb2e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:27:31 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cbf690-6252-4871-85ac-a09b79a52988]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d] added
Aug 17 04:27:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d563aa-36cb-43c8-9cb4-a5ec5b7a7edb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c53852-363d-4b0b-9365-ebfd3c71326c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNgkliFP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNgkliFP" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc28f45-d265-4bd0-8fe2-1c757404af39]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNgkliFP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[18630840-a110-4d0d-9387-4ea1e9a4825e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[956754a2-4b83-4a5e-947f-a2ecb301220e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c4bcb-0c4a-449d-ac3f-5f55000284c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260]
Aug 17 04:27:32 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260] successful.
Aug 17 04:27:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcdffc8-74bb-4ac4-935c-3f3f7f433e02]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82d2398-fb50-4a09-9c5f-c24ed321d451]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:32 user nova-compute[72793]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d (non-flash)
Aug 17 04:27:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:32 user nova-compute[72793]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d (non-flash)
Aug 17 04:27:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bee545-7ff4-48d6-aa04-6b75e80edbff]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNgkliFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23837633262373964', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837633262373964', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:27:33 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:27:33 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:27:33 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:27:33 user nova-compute[72793]:   <serial>6724e7f6-0828-406c-870d-345c7881791d</serial>
Aug 17 04:27:33 user nova-compute[72793]: </disk>
Aug 17 04:27:33 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:f4:ea:3c, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:27:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-198cd229-3f82-407b-94a0-bfb6bff16b81 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.710s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:34 user nova-compute[72793]: INFO nova.compute.manager [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Detaching volume 6724e7f6-0828-406c-870d-345c7881791d
Aug 17 04:27:34 user nova-compute[72793]: INFO nova.virt.block_device [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Attempting to driver detach volume 6724e7f6-0828-406c-870d-345c7881791d from mountpoint /dev/vdb
Aug 17 04:27:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Attempting to detach device vdb from instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:27:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:27:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:27:34 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:27:34 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:27:34 user nova-compute[72793]:   <serial>6724e7f6-0828-406c-870d-345c7881791d</serial>
Aug 17 04:27:34 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:27:34 user nova-compute[72793]: </disk>
Aug 17 04:27:34 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:27:34 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully detached device vdb from instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 from the persistent domain config.
Aug 17 04:27:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:27:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:27:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:27:34 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:27:34 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:27:34 user nova-compute[72793]:   <serial>6724e7f6-0828-406c-870d-345c7881791d</serial>
Aug 17 04:27:34 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:27:34 user nova-compute[72793]: </disk>
Aug 17 04:27:34 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692246455.237567, d58613bf-f8c0-4bea-9533-6f3ffd859c82 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:27:35 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully detached device vdb from instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 from the live domain config.
Aug 17 04:27:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNgkliFP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:27:35 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19d93d0-e39f-4bfd-b186-61f4f57472e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[854db850-b5ff-4adf-a8e7-29b2d0c1ffb0]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:35 user nova-compute[72793]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d (non-flash)
Aug 17 04:27:35 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:35 user nova-compute[72793]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d (non-flash)
Aug 17 04:27:35 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02ca5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a4b65-85d8-434e-be37-5863eb0e5d55]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e61680d-b381-4ab6-a1f3-3a1571db5b9e]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4200d36-1333-4dc6-aa5d-54cb29950aa4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7536af7-3573-4d84-ae01-49e9d2dd46de]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[789534a1-9754-4ed2-9ab4-d7e24e084306]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[64459f16-475e-473e-b429-7debefc28c9c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260]
Aug 17 04:27:35 user nova-compute[72793]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d, portal: 172.16.0.220,3260] successful.
Aug 17 04:27:35 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6724e7f6-0828-406c-870d-345c7881791d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9906f3bb-6bdc-439a-82b6-e1684b950547]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== disconnect_volume: return (268ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:27:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:27:36 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e744ff4f-2e3b-4b2f-af5d-24dcb653f0e2 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:39 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:27:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:27:39 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:27:39 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:27:40 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance destroyed successfully.
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'resources' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3851205d-1f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:27:40 user nova-compute[72793]: INFO os_vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f')
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:27:40 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0be60b-ebc0-46a4-9e7a-5101c3783b55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043bef2-2d09-43cc-bd6a-6d6b25167c61]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f02f27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[64913726-933f-48ef-9834-ccb55b00f0a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eda1226-d27b-4ecf-a3b2-f0b5304ac9af]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868a115-eb66-4c39-887a-32332d23dfac]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c43c071-5fde-4d2d-b51f-e87cb960ebf3]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c93ab15-6814-4867-aa48-31f4337c358a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c371c3f-fa34-41db-bb98-61c35f0a4b49]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]
Aug 17 04:27:40 user nova-compute[72793]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.
Aug 17 04:27:40 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b115f62-1d3a-4c93-bf76-d9ce1c4e96af]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== disconnect_volume: return (255ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start _get_guest_xml network_info=[{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6a40379d-ca08-4b3e-95f6-61d93d529162', 'attached_at': '', 'detached_at': '', 'volume_id': 'c28ff0bc-93fb-42ae-9e73-8b7c61906b8b', 'serial': 'c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'}, 'guest_format': None, 'attachment_id': '1e689c0e-bf60-43fa-b84e-53fd98666044', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:40 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:27:40 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:27:40 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:27:40 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:27:40 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:27:40 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:27:40 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d02c0-ad13-438d-be3d-161bb0535b37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:27:41 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b75f6b-88a7-4f77-b012-43d7386220ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b] added
Aug 17 04:27:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c85305-082c-4f91-b139-5f9ca9702bd0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69995ce-2b6d-4c7e-b894-94c48e2a78a4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPiJyZDd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPiJyZDd" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7d971-5a76-4ebf-876c-30ea1543850a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPiJyZDd'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79263dc-251f-4cb7-ae77-c4784823ef3c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e76dc69-24e0-420b-8035-7d6ed1e79376]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:27:41 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:27:41 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:27:41 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:27:41 user nova-compute[72793]: 
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c1a1e-03e9-4554-8edc-6cc70a1565cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]
Aug 17 04:27:41 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.
Aug 17 04:27:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f713d31-5c1c-4bcc-9ee8-b36ebfca3c21]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec00a66-3839-40eb-ae13-5ea6d10039da]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:27:41 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea51bd-a138-434d-b5ad-8c0291c5183c]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:27:41 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23961333763326363', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961333763326363', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:27:42 user nova-compute[72793]:   <uuid>6a40379d-ca08-4b3e-95f6-61d93d529162</uuid>
Aug 17 04:27:42 user nova-compute[72793]:   <name>instance-00000029</name>
Aug 17 04:27:42 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:27:42 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:27:42 user nova-compute[72793]:   <metadata>
Aug 17 04:27:42 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:27:42 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:27:42 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeTestJSON-server-1580509719</nova:name>
Aug 17 04:27:42 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:27:40</nova:creationTime>
Aug 17 04:27:42 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:27:42 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:27:42 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:27:42 user nova-compute[72793]:       <nova:owner>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:user uuid="302b737fd798432683e98f2c60b76b71">tempest-AttachVolumeTestJSON-769655846-project-member</nova:user>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:project uuid="863a28bd4f24493fa848df117d9edac7">tempest-AttachVolumeTestJSON-769655846</nova:project>
Aug 17 04:27:42 user nova-compute[72793]:       </nova:owner>
Aug 17 04:27:42 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:27:42 user nova-compute[72793]:       <nova:ports>
Aug 17 04:27:42 user nova-compute[72793]:         <nova:port uuid="3851205d-1f2c-48b0-b097-b172f3b5ace9">
Aug 17 04:27:42 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:27:42 user nova-compute[72793]:         </nova:port>
Aug 17 04:27:42 user nova-compute[72793]:       </nova:ports>
Aug 17 04:27:42 user nova-compute[72793]:     </nova:instance>
Aug 17 04:27:42 user nova-compute[72793]:   </metadata>
Aug 17 04:27:42 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:27:42 user nova-compute[72793]:     <system>
Aug 17 04:27:42 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:27:42 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:27:42 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:27:42 user nova-compute[72793]:       <entry name="serial">6a40379d-ca08-4b3e-95f6-61d93d529162</entry>
Aug 17 04:27:42 user nova-compute[72793]:       <entry name="uuid">6a40379d-ca08-4b3e-95f6-61d93d529162</entry>
Aug 17 04:27:42 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:27:42 user nova-compute[72793]:     </system>
Aug 17 04:27:42 user nova-compute[72793]:   </sysinfo>
Aug 17 04:27:42 user nova-compute[72793]:   <os>
Aug 17 04:27:42 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:27:42 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:27:42 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:27:42 user nova-compute[72793]:   </os>
Aug 17 04:27:42 user nova-compute[72793]:   <features>
Aug 17 04:27:42 user nova-compute[72793]:     <acpi/>
Aug 17 04:27:42 user nova-compute[72793]:     <apic/>
Aug 17 04:27:42 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:27:42 user nova-compute[72793]:   </features>
Aug 17 04:27:42 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:27:42 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:27:42 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:27:42 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:27:42 user nova-compute[72793]:   </clock>
Aug 17 04:27:42 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:27:42 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:27:42 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:27:42 user nova-compute[72793]:   </cpu>
Aug 17 04:27:42 user nova-compute[72793]:   <devices>
Aug 17 04:27:42 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:27:42 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:27:42 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk"/>
Aug 17 04:27:42 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:27:42 user nova-compute[72793]:     </disk>
Aug 17 04:27:42 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:27:42 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:27:42 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:27:42 user nova-compute[72793]:       <target dev="vdb" bus="virtio"/>
Aug 17 04:27:42 user nova-compute[72793]:       <serial>c28ff0bc-93fb-42ae-9e73-8b7c61906b8b</serial>
Aug 17 04:27:42 user nova-compute[72793]:     </disk>
Aug 17 04:27:42 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:27:42 user nova-compute[72793]:       <mac address="fa:16:3e:f5:c0:2d"/>
Aug 17 04:27:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:27:42 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:27:42 user nova-compute[72793]:       <target dev="tap3851205d-1f"/>
Aug 17 04:27:42 user nova-compute[72793]:     </interface>
Aug 17 04:27:42 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:27:42 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/console.log" append="off"/>
Aug 17 04:27:42 user nova-compute[72793]:     </serial>
Aug 17 04:27:42 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:27:42 user nova-compute[72793]:     <video>
Aug 17 04:27:42 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:27:42 user nova-compute[72793]:     </video>
Aug 17 04:27:42 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:27:42 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:27:42 user nova-compute[72793]:     </rng>
Aug 17 04:27:42 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:27:42 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:27:42 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:27:42 user nova-compute[72793]:     </memballoon>
Aug 17 04:27:42 user nova-compute[72793]:   </devices>
Aug 17 04:27:42 user nova-compute[72793]: </domain>
Aug 17 04:27:42 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:27:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Cannot resize image /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'migration_context' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG os_vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3851205d-1f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3851205d-1f, col_values=(('external_ids', {'iface-id': '3851205d-1f2c-48b0-b097-b172f3b5ace9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:2d', 'vm-uuid': '6a40379d-ca08-4b3e-95f6-61d93d529162'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:27:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:43 user nova-compute[72793]: INFO os_vif [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f')
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-98bc634a-0f1c-4a49-9975-4039208987a9 req-c99b9ef6-a077-4b71-8caf-0bc953cb2b07 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98bc634a-0f1c-4a49-9975-4039208987a9 req-c99b9ef6-a077-4b71-8caf-0bc953cb2b07 service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98bc634a-0f1c-4a49-9975-4039208987a9 req-c99b9ef6-a077-4b71-8caf-0bc953cb2b07 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-98bc634a-0f1c-4a49-9975-4039208987a9 req-c99b9ef6-a077-4b71-8caf-0bc953cb2b07 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-98bc634a-0f1c-4a49-9975-4039208987a9 req-c99b9ef6-a077-4b71-8caf-0bc953cb2b07 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:27:44 user nova-compute[72793]: WARNING nova.compute.manager [req-98bc634a-0f1c-4a49-9975-4039208987a9 req-c99b9ef6-a077-4b71-8caf-0bc953cb2b07 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state stopped and task_state powering-on.
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246466.4821715, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:27:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Resumed (Lifecycle Event)
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:27:46 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance rebooted successfully.
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fbad8eef-51a1-4cf7-ad3f-c2ed1f823b3d tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:27:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246466.4860435, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:27:46 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Started (Lifecycle Event)
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2d04484f-0e41-4f94-b44f-bbfedcb321b2 req-37d92f40-453e-40d4-9013-f6d608a7839c service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2d04484f-0e41-4f94-b44f-bbfedcb321b2 req-37d92f40-453e-40d4-9013-f6d608a7839c service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2d04484f-0e41-4f94-b44f-bbfedcb321b2 req-37d92f40-453e-40d4-9013-f6d608a7839c service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2d04484f-0e41-4f94-b44f-bbfedcb321b2 req-37d92f40-453e-40d4-9013-f6d608a7839c service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:27:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-2d04484f-0e41-4f94-b44f-bbfedcb321b2 req-37d92f40-453e-40d4-9013-f6d608a7839c service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:27:46 user nova-compute[72793]: WARNING nova.compute.manager [req-2d04484f-0e41-4f94-b44f-bbfedcb321b2 req-37d92f40-453e-40d4-9013-f6d608a7839c service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state active and task_state None.
Aug 17 04:27:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:27:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:20 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:28:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:28:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:28:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8599MB free_disk=25.321998596191406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d58613bf-f8c0-4bea-9533-6f3ffd859c82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:24 user nova-compute[72793]: INFO nova.compute.manager [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Terminating instance
Aug 17 04:28:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-5b035f3d-7477-4437-994f-1114da599c80 req-3ef9b256-6080-42ce-8b1b-fb72267632a5 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-vif-unplugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5b035f3d-7477-4437-994f-1114da599c80 req-3ef9b256-6080-42ce-8b1b-fb72267632a5 service nova] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5b035f3d-7477-4437-994f-1114da599c80 req-3ef9b256-6080-42ce-8b1b-fb72267632a5 service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5b035f3d-7477-4437-994f-1114da599c80 req-3ef9b256-6080-42ce-8b1b-fb72267632a5 service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-5b035f3d-7477-4437-994f-1114da599c80 req-3ef9b256-6080-42ce-8b1b-fb72267632a5 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] No waiting events found dispatching network-vif-unplugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-5b035f3d-7477-4437-994f-1114da599c80 req-3ef9b256-6080-42ce-8b1b-fb72267632a5 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-vif-unplugged-4def59df-725e-4421-a4b1-18bd5df66e90 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Instance destroyed successfully.
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'resources' on Instance uuid d58613bf-f8c0-4bea-9533-6f3ffd859c82 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:25:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-522226453',display_name='tempest-AttachVolumeNegativeTest-server-522226453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-522226453',id=42,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiIRDJuI2l4x/36Dcb0sanQ3PzlH1LTVnzpdqTaSCuEYaOfW71HU6nvuO11CsaKV2PIfncGxvQkPKk8LdOc6nrYyvg+pLddy/naTryzmdIgke2zqxn8DtzsxvkLEx+I5g==',key_name='tempest-keypair-687654916',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-lsxtpy1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:25:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=d58613bf-f8c0-4bea-9533-6f3ffd859c82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "4def59df-725e-4421-a4b1-18bd5df66e90", "address": "fa:16:3e:f4:ea:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4def59df-72", "ovs_interfaceid": "4def59df-725e-4421-a4b1-18bd5df66e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG os_vif [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4def59df-72, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:28:25 user nova-compute[72793]: INFO os_vif [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ea:3c,bridge_name='br-int',has_traffic_filtering=True,id=4def59df-725e-4421-a4b1-18bd5df66e90,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4def59df-72')
Aug 17 04:28:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Deleting instance files /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82_del
Aug 17 04:28:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Deletion of /opt/stack/data/nova/instances/d58613bf-f8c0-4bea-9533-6f3ffd859c82_del complete
Aug 17 04:28:25 user nova-compute[72793]: INFO nova.compute.manager [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 04:28:25 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:28:25 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:28:26 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:28:26 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Took 1.05 seconds to deallocate network for instance.
Aug 17 04:28:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-ad6cc420-fd80-487d-8034-b426d81136bc req-c4638f3b-0888-40c0-a11d-21e58f647278 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-vif-deleted-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:28:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:27 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Deleted allocations for instance d58613bf-f8c0-4bea-9533-6f3ffd859c82
Aug 17 04:28:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2421ec4f-c189-4e97-96b1-823fb76bf61d tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-5c144dc4-359f-4392-ac18-74112f6970b7 req-d76f795a-2372-4ba5-8b00-e06cbed78fc8 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received event network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5c144dc4-359f-4392-ac18-74112f6970b7 req-d76f795a-2372-4ba5-8b00-e06cbed78fc8 service nova] Acquiring lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5c144dc4-359f-4392-ac18-74112f6970b7 req-d76f795a-2372-4ba5-8b00-e06cbed78fc8 service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5c144dc4-359f-4392-ac18-74112f6970b7 req-d76f795a-2372-4ba5-8b00-e06cbed78fc8 service nova] Lock "d58613bf-f8c0-4bea-9533-6f3ffd859c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:28:27 user nova-compute[72793]: DEBUG nova.compute.manager [req-5c144dc4-359f-4392-ac18-74112f6970b7 req-d76f795a-2372-4ba5-8b00-e06cbed78fc8 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] No waiting events found dispatching network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:28:27 user nova-compute[72793]: WARNING nova.compute.manager [req-5c144dc4-359f-4392-ac18-74112f6970b7 req-d76f795a-2372-4ba5-8b00-e06cbed78fc8 service nova] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Received unexpected event network-vif-plugged-4def59df-725e-4421-a4b1-18bd5df66e90 for instance with vm_state deleted and task_state None.
Aug 17 04:28:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:28:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:28:32 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:28:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:28:40 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246505.7404366, d58613bf-f8c0-4bea-9533-6f3ffd859c82 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:28:40 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] VM Stopped (Lifecycle Event)
Aug 17 04:28:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-410c2b57-5c92-4a8d-b1a5-106164d3c584 None None] [instance: d58613bf-f8c0-4bea-9533-6f3ffd859c82] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:28:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:28:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:28:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:28:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:28:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:29:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:29:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:29:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:29:19 user nova-compute[72793]: INFO nova.compute.claims [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Claim successful on node user
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:29:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.policy [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '621ab8c1ef2c4af2a0baf1390a22ff56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12975ec6f4e740808d9bdd0be12181e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:29:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Creating image(s)
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "/opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:19 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk 1073741824" returned: 0 in 0.052s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.208s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Successfully created port: ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Cannot resize image /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'migration_context' on Instance uuid 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Ensure instance console log exists: /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Successfully updated port: ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquired lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-changed-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Refreshing instance network info cache due to event network-changed-ffb37d50-ea97-4619-a5b6-932ca97f3c47. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] Acquiring lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.neutron [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updating instance_info_cache with network_info: [{"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Releasing lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Instance network_info: |[{"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] Acquired lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.neutron [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Refreshing network info cache for port ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Start _get_guest_xml network_info=[{"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:29:21 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:29:21 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1967226500',display_name='tempest-AttachVolumeNegativeTest-server-1967226500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1967226500',id=43,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6IN7Glx/Tb7016By+rrKoDbE1Ufn5j8973inPgNyMcGWfKJHBwMmFkqHORqR1O9Zdva8Ni93MDM6ywXTtHMXo0TA5v835dM8c152qmGY+0+abft92T7KvP01BKuLczGQ==',key_name='tempest-keypair-1987562175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-islvdf8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:29:21 user nova-compute[72793]:   <uuid>8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f</uuid>
Aug 17 04:29:21 user nova-compute[72793]:   <name>instance-0000002b</name>
Aug 17 04:29:21 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:29:21 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:29:21 user nova-compute[72793]:   <metadata>
Aug 17 04:29:21 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:29:21 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:29:21 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1967226500</nova:name>
Aug 17 04:29:21 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:29:21</nova:creationTime>
Aug 17 04:29:21 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:29:21 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:29:21 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:29:21 user nova-compute[72793]:       <nova:owner>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:user uuid="621ab8c1ef2c4af2a0baf1390a22ff56">tempest-AttachVolumeNegativeTest-1865038023-project-member</nova:user>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:project uuid="12975ec6f4e740808d9bdd0be12181e7">tempest-AttachVolumeNegativeTest-1865038023</nova:project>
Aug 17 04:29:21 user nova-compute[72793]:       </nova:owner>
Aug 17 04:29:21 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:29:21 user nova-compute[72793]:       <nova:ports>
Aug 17 04:29:21 user nova-compute[72793]:         <nova:port uuid="ffb37d50-ea97-4619-a5b6-932ca97f3c47">
Aug 17 04:29:21 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 04:29:21 user nova-compute[72793]:         </nova:port>
Aug 17 04:29:21 user nova-compute[72793]:       </nova:ports>
Aug 17 04:29:21 user nova-compute[72793]:     </nova:instance>
Aug 17 04:29:21 user nova-compute[72793]:   </metadata>
Aug 17 04:29:21 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:29:21 user nova-compute[72793]:     <system>
Aug 17 04:29:21 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:29:21 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:29:21 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:29:21 user nova-compute[72793]:       <entry name="serial">8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f</entry>
Aug 17 04:29:21 user nova-compute[72793]:       <entry name="uuid">8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f</entry>
Aug 17 04:29:21 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:29:21 user nova-compute[72793]:     </system>
Aug 17 04:29:21 user nova-compute[72793]:   </sysinfo>
Aug 17 04:29:21 user nova-compute[72793]:   <os>
Aug 17 04:29:21 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:29:21 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:29:21 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:29:21 user nova-compute[72793]:   </os>
Aug 17 04:29:21 user nova-compute[72793]:   <features>
Aug 17 04:29:21 user nova-compute[72793]:     <acpi/>
Aug 17 04:29:21 user nova-compute[72793]:     <apic/>
Aug 17 04:29:21 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:29:21 user nova-compute[72793]:   </features>
Aug 17 04:29:21 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:29:21 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:29:21 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:29:21 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:29:21 user nova-compute[72793]:   </clock>
Aug 17 04:29:21 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:29:21 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:29:21 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:29:21 user nova-compute[72793]:   </cpu>
Aug 17 04:29:21 user nova-compute[72793]:   <devices>
Aug 17 04:29:21 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:29:21 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:29:21 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk"/>
Aug 17 04:29:21 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:29:21 user nova-compute[72793]:     </disk>
Aug 17 04:29:21 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:29:21 user nova-compute[72793]:       <mac address="fa:16:3e:77:c0:3c"/>
Aug 17 04:29:21 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:29:21 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:29:21 user nova-compute[72793]:       <target dev="tapffb37d50-ea"/>
Aug 17 04:29:21 user nova-compute[72793]:     </interface>
Aug 17 04:29:21 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:29:21 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/console.log" append="off"/>
Aug 17 04:29:21 user nova-compute[72793]:     </serial>
Aug 17 04:29:21 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:29:21 user nova-compute[72793]:     <video>
Aug 17 04:29:21 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:29:21 user nova-compute[72793]:     </video>
Aug 17 04:29:21 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:29:21 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:29:21 user nova-compute[72793]:     </rng>
Aug 17 04:29:21 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:29:21 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:29:21 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:29:21 user nova-compute[72793]:     </memballoon>
Aug 17 04:29:21 user nova-compute[72793]:   </devices>
Aug 17 04:29:21 user nova-compute[72793]: </domain>
Aug 17 04:29:21 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1967226500',display_name='tempest-AttachVolumeNegativeTest-server-1967226500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1967226500',id=43,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6IN7Glx/Tb7016By+rrKoDbE1Ufn5j8973inPgNyMcGWfKJHBwMmFkqHORqR1O9Zdva8Ni93MDM6ywXTtHMXo0TA5v835dM8c152qmGY+0+abft92T7KvP01BKuLczGQ==',key_name='tempest-keypair-1987562175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-islvdf8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:29:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG os_vif [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffb37d50-ea, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffb37d50-ea, col_values=(('external_ids', {'iface-id': 'ffb37d50-ea97-4619-a5b6-932ca97f3c47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:c0:3c', 'vm-uuid': '8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:21 user nova-compute[72793]: INFO os_vif [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea')
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:29:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:77:c0:3c, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:29:22 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updated VIF entry in instance network info cache for port ffb37d50-ea97-4619-a5b6-932ca97f3c47. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:29:22 user nova-compute[72793]: DEBUG nova.network.neutron [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updating instance_info_cache with network_info: [{"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:29:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5dd67b44-ad40-4b63-890b-4de01a2d516d req-77c84f5a-7de1-4076-9b28-3b348a6354af service nova] Releasing lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-a7ea9171-13b4-440d-a0b6-513a172df5b1 req-49e9a7c1-bc05-436d-8a9c-5dcffe267a43 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a7ea9171-13b4-440d-a0b6-513a172df5b1 req-49e9a7c1-bc05-436d-8a9c-5dcffe267a43 service nova] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a7ea9171-13b4-440d-a0b6-513a172df5b1 req-49e9a7c1-bc05-436d-8a9c-5dcffe267a43 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-a7ea9171-13b4-440d-a0b6-513a172df5b1 req-49e9a7c1-bc05-436d-8a9c-5dcffe267a43 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-a7ea9171-13b4-440d-a0b6-513a172df5b1 req-49e9a7c1-bc05-436d-8a9c-5dcffe267a43 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] No waiting events found dispatching network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:29:23 user nova-compute[72793]: WARNING nova.compute.manager [req-a7ea9171-13b4-440d-a0b6-513a172df5b1 req-49e9a7c1-bc05-436d-8a9c-5dcffe267a43 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received unexpected event network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 for instance with vm_state building and task_state spawning.
Aug 17 04:29:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246565.2224278, 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] VM Resumed (Lifecycle Event)
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Instance spawned successfully.
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:29:25 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:29:25 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=25.34811019897461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246565.2232363, 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] VM Started (Lifecycle Event)
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Took 5.67 seconds to spawn the instance on the hypervisor.
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:25 user nova-compute[72793]: INFO nova.compute.manager [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Took 6.34 seconds to build instance.
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3574521d-8cd9-4755-a3db-a975ddfda277 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.429s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-140682ff-c15c-4e0b-bd05-a94562d4c8f1 req-58a4554f-63d1-4d26-a64a-42e37de72529 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-140682ff-c15c-4e0b-bd05-a94562d4c8f1 req-58a4554f-63d1-4d26-a64a-42e37de72529 service nova] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-140682ff-c15c-4e0b-bd05-a94562d4c8f1 req-58a4554f-63d1-4d26-a64a-42e37de72529 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-140682ff-c15c-4e0b-bd05-a94562d4c8f1 req-58a4554f-63d1-4d26-a64a-42e37de72529 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-140682ff-c15c-4e0b-bd05-a94562d4c8f1 req-58a4554f-63d1-4d26-a64a-42e37de72529 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] No waiting events found dispatching network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:29:25 user nova-compute[72793]: WARNING nova.compute.manager [req-140682ff-c15c-4e0b-bd05-a94562d4c8f1 req-58a4554f-63d1-4d26-a64a-42e37de72529 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received unexpected event network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 for instance with vm_state active and task_state None.
Aug 17 04:29:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:30 user nova-compute[72793]: INFO nova.compute.manager [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Detaching volume c28ff0bc-93fb-42ae-9e73-8b7c61906b8b
Aug 17 04:29:30 user nova-compute[72793]: INFO nova.virt.block_device [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Attempting to driver detach volume c28ff0bc-93fb-42ae-9e73-8b7c61906b8b from mountpoint /dev/vdb
Aug 17 04:29:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Attempting to detach device vdb from instance 6a40379d-ca08-4b3e-95f6-61d93d529162 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:29:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:29:30 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:29:30 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:29:30 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:29:30 user nova-compute[72793]:   <serial>c28ff0bc-93fb-42ae-9e73-8b7c61906b8b</serial>
Aug 17 04:29:30 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:29:30 user nova-compute[72793]: </disk>
Aug 17 04:29:30 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:29:30 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully detached device vdb from instance 6a40379d-ca08-4b3e-95f6-61d93d529162 from the persistent domain config.
Aug 17 04:29:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a40379d-ca08-4b3e-95f6-61d93d529162 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:29:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:29:30 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:29:30 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:29:30 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:29:30 user nova-compute[72793]:   <serial>c28ff0bc-93fb-42ae-9e73-8b7c61906b8b</serial>
Aug 17 04:29:30 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 04:29:30 user nova-compute[72793]: </disk>
Aug 17 04:29:30 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692246571.2177298, 6a40379d-ca08-4b3e-95f6-61d93d529162 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:29:31 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully detached device vdb from instance 6a40379d-ca08-4b3e-95f6-61d93d529162 from the live domain config.
Aug 17 04:29:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPiJyZDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:29:31 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a2afd1-90cc-42cb-8ce2-936131448c76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f0eb29-5249-4c5a-9ec9-005b0b016acc]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:29:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b (non-flash)
Aug 17 04:29:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02cb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e36716-2634-473d-831b-de96d64636b4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba050083-8f55-4975-b924-9b7a163093ee]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ef09c9-4b65-44ca-bbf2-124db01f6850]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae491e13-0c19-4092-a9ca-fd25a6fde51b]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00ccbc5-9325-4a38-8ef9-3844d97d960e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed0e1d-ce7d-4e30-99a3-112df8d623a7]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260]
Aug 17 04:29:31 user nova-compute[72793]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b, portal: 172.16.0.220,3260] successful.
Aug 17 04:29:31 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28ff0bc-93fb-42ae-9e73-8b7c61906b8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[699d873c-8223-466c-8399-cc7f8b884e73]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== disconnect_volume: return (253ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:31 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e4ba45c8-eb14-4b36-a4f6-34d535cd1c49 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG nova.compute.manager [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG nova.compute.manager [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72793) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG nova.objects.instance [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:29:32 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-4b383963-ac9d-4350-9734-29b3c95c3b7c req-0ec1db8d-3209-4b54-a9f7-f9135f74be8d service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4b383963-ac9d-4350-9734-29b3c95c3b7c req-0ec1db8d-3209-4b54-a9f7-f9135f74be8d service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4b383963-ac9d-4350-9734-29b3c95c3b7c req-0ec1db8d-3209-4b54-a9f7-f9135f74be8d service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4b383963-ac9d-4350-9734-29b3c95c3b7c req-0ec1db8d-3209-4b54-a9f7-f9135f74be8d service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.compute.manager [req-4b383963-ac9d-4350-9734-29b3c95c3b7c req-0ec1db8d-3209-4b54-a9f7-f9135f74be8d service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:29:33 user nova-compute[72793]: WARNING nova.compute.manager [req-4b383963-ac9d-4350-9734-29b3c95c3b7c req-0ec1db8d-3209-4b54-a9f7-f9135f74be8d service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state active and task_state powering-off.
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance destroyed successfully.
Aug 17 04:29:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:29:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-092b5912-2d4e-4bc1-a119-6f5580f0fff6 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.848s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:29:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-b042f4c4-5d5c-4a9c-89ba-ff2f3cf84e36 req-2ff93911-16f1-402e-bc45-1bc856e1c883 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:29:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b042f4c4-5d5c-4a9c-89ba-ff2f3cf84e36 req-2ff93911-16f1-402e-bc45-1bc856e1c883 service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:29:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b042f4c4-5d5c-4a9c-89ba-ff2f3cf84e36 req-2ff93911-16f1-402e-bc45-1bc856e1c883 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:29:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b042f4c4-5d5c-4a9c-89ba-ff2f3cf84e36 req-2ff93911-16f1-402e-bc45-1bc856e1c883 service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:29:35 user nova-compute[72793]: DEBUG nova.compute.manager [req-b042f4c4-5d5c-4a9c-89ba-ff2f3cf84e36 req-2ff93911-16f1-402e-bc45-1bc856e1c883 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:29:35 user nova-compute[72793]: WARNING nova.compute.manager [req-b042f4c4-5d5c-4a9c-89ba-ff2f3cf84e36 req-2ff93911-16f1-402e-bc45-1bc856e1c883 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state stopped and task_state None.
Aug 17 04:29:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:48 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246573.7177832, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:29:48 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Stopped (Lifecycle Event)
Aug 17 04:29:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c0179e22-21ad-4000-944d-1eee344522dd None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:29:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c0179e22-21ad-4000-944d-1eee344522dd None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:29:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:29:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:30:27 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:30:27 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.319171905517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:30:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:30:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updating instance_info_cache with network_info: [{"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:30:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:30:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:30:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-changed-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:31:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Refreshing instance network info cache due to event network-changed-ffb37d50-ea97-4619-a5b6-932ca97f3c47. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:31:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] Acquiring lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:31:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] Acquired lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:31:10 user nova-compute[72793]: DEBUG nova.network.neutron [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Refreshing network info cache for port ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:31:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:11 user nova-compute[72793]: DEBUG nova.network.neutron [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updated VIF entry in instance network info cache for port ffb37d50-ea97-4619-a5b6-932ca97f3c47. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:31:11 user nova-compute[72793]: DEBUG nova.network.neutron [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updating instance_info_cache with network_info: [{"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:31:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ffae410a-46a0-4c93-831e-fe91f02489f2 req-a4e4c614-f74c-4b03-ba64-903c36d68ffa service nova] Releasing lock "refresh_cache-8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:31:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:15 user nova-compute[72793]: INFO nova.compute.manager [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Attaching volume d3e75864-24c7-405c-8657-e87f42191361 to /dev/vdb
Aug 17 04:31:15 user nova-compute[72793]: DEBUG os_brick.utils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e645fa-a891-4e46-ae9e-f541ba43c868]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff60aab3-fdca-4ea6-be21-c01e65c0e0e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c3f5d-e55b-4990-acb8-d6702c590f3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[82740aec-daf8-4f97-917f-76a9a42c28eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:31:15 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:31:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c183d5-47c0-4832-acc2-5625533ff442]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG os_brick.utils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:31:15 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updating existing volume attachment record: 85b3b198-ecb8-4e95-9c12-83ceff2a9369 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:31:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:23 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:31:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:31:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:31:23 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:31:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance destroyed successfully.
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'resources' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG os_vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3851205d-1f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:31:24 user nova-compute[72793]: INFO os_vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f')
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start _get_guest_xml network_info=[{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:31:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:31:24 user nova-compute[72793]:   <uuid>6a40379d-ca08-4b3e-95f6-61d93d529162</uuid>
Aug 17 04:31:24 user nova-compute[72793]:   <name>instance-00000029</name>
Aug 17 04:31:24 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:31:24 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:31:24 user nova-compute[72793]:   <metadata>
Aug 17 04:31:24 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:31:24 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:31:24 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeTestJSON-server-1580509719</nova:name>
Aug 17 04:31:24 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:31:24</nova:creationTime>
Aug 17 04:31:24 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:31:24 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:31:24 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:31:24 user nova-compute[72793]:       <nova:owner>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:user uuid="302b737fd798432683e98f2c60b76b71">tempest-AttachVolumeTestJSON-769655846-project-member</nova:user>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:project uuid="863a28bd4f24493fa848df117d9edac7">tempest-AttachVolumeTestJSON-769655846</nova:project>
Aug 17 04:31:24 user nova-compute[72793]:       </nova:owner>
Aug 17 04:31:24 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:31:24 user nova-compute[72793]:       <nova:ports>
Aug 17 04:31:24 user nova-compute[72793]:         <nova:port uuid="3851205d-1f2c-48b0-b097-b172f3b5ace9">
Aug 17 04:31:24 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:31:24 user nova-compute[72793]:         </nova:port>
Aug 17 04:31:24 user nova-compute[72793]:       </nova:ports>
Aug 17 04:31:24 user nova-compute[72793]:     </nova:instance>
Aug 17 04:31:24 user nova-compute[72793]:   </metadata>
Aug 17 04:31:24 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:31:24 user nova-compute[72793]:     <system>
Aug 17 04:31:24 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:31:24 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:31:24 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:31:24 user nova-compute[72793]:       <entry name="serial">6a40379d-ca08-4b3e-95f6-61d93d529162</entry>
Aug 17 04:31:24 user nova-compute[72793]:       <entry name="uuid">6a40379d-ca08-4b3e-95f6-61d93d529162</entry>
Aug 17 04:31:24 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:31:24 user nova-compute[72793]:     </system>
Aug 17 04:31:24 user nova-compute[72793]:   </sysinfo>
Aug 17 04:31:24 user nova-compute[72793]:   <os>
Aug 17 04:31:24 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:31:24 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:31:24 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:31:24 user nova-compute[72793]:   </os>
Aug 17 04:31:24 user nova-compute[72793]:   <features>
Aug 17 04:31:24 user nova-compute[72793]:     <acpi/>
Aug 17 04:31:24 user nova-compute[72793]:     <apic/>
Aug 17 04:31:24 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:31:24 user nova-compute[72793]:   </features>
Aug 17 04:31:24 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:31:24 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:31:24 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:31:24 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:31:24 user nova-compute[72793]:   </clock>
Aug 17 04:31:24 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:31:24 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:31:24 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:31:24 user nova-compute[72793]:   </cpu>
Aug 17 04:31:24 user nova-compute[72793]:   <devices>
Aug 17 04:31:24 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:31:24 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:31:24 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk"/>
Aug 17 04:31:24 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:31:24 user nova-compute[72793]:     </disk>
Aug 17 04:31:24 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:31:24 user nova-compute[72793]:       <mac address="fa:16:3e:f5:c0:2d"/>
Aug 17 04:31:24 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:31:24 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:31:24 user nova-compute[72793]:       <target dev="tap3851205d-1f"/>
Aug 17 04:31:24 user nova-compute[72793]:     </interface>
Aug 17 04:31:24 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:31:24 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/console.log" append="off"/>
Aug 17 04:31:24 user nova-compute[72793]:     </serial>
Aug 17 04:31:24 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:31:24 user nova-compute[72793]:     <video>
Aug 17 04:31:24 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:31:24 user nova-compute[72793]:     </video>
Aug 17 04:31:24 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:31:24 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:31:24 user nova-compute[72793]:     </rng>
Aug 17 04:31:24 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:31:24 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:31:24 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:31:24 user nova-compute[72793]:     </memballoon>
Aug 17 04:31:24 user nova-compute[72793]:   </devices>
Aug 17 04:31:24 user nova-compute[72793]: </domain>
Aug 17 04:31:24 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.170s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:31:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Cannot resize image /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'migration_context' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3851205d-1f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3851205d-1f, col_values=(('external_ids', {'iface-id': '3851205d-1f2c-48b0-b097-b172f3b5ace9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:2d', 'vm-uuid': '6a40379d-ca08-4b3e-95f6-61d93d529162'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:25 user nova-compute[72793]: INFO os_vif [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f')
Aug 17 04:31:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOIXwnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:31:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:31:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:31:25 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6715d0-ef51-462c-9ba0-b7f175453fd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:31:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd911a8-1eb8-42c8-8ce3-9d2e4e92f9d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361] added
Aug 17 04:31:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7364a8-8183-4fab-831b-d96b3187cbe3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc4a69b-d295-4f31-9777-a7defa72985a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOIXwnBa {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UOIXwnBa" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740aa33-4fd4-47c3-9948-cd3f53b37c24]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UOIXwnBa'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1cdc5-d350-4d7b-8a9b-e6cce3855f18]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c5eb64-a7a3-4fa9-b4f3-ec58f75bb148]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:31:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:31:25 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:31:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:31:25 user nova-compute[72793]: 
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[692e2347-88f2-499d-96e4-bfa8e007d15f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260]
Aug 17 04:31:25 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260] successful.
Aug 17 04:31:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e494803-5941-4dae-80da-94500bc161ef]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b2748a-4d9d-4ead-88dd-4020ee794b31]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 (non-flash)
Aug 17 04:31:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 (non-flash)
Aug 17 04:31:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[34340101-319c-45b3-89b5-173d17434ede]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOIXwnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d1b4a1d-8e3c-477d-87c1-1f1c4743809c req-961cad53-7840-440b-8248-a0482760bd4b service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d1b4a1d-8e3c-477d-87c1-1f1c4743809c req-961cad53-7840-440b-8248-a0482760bd4b service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d1b4a1d-8e3c-477d-87c1-1f1c4743809c req-961cad53-7840-440b-8248-a0482760bd4b service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1d1b4a1d-8e3c-477d-87c1-1f1c4743809c req-961cad53-7840-440b-8248-a0482760bd4b service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-1d1b4a1d-8e3c-477d-87c1-1f1c4743809c req-961cad53-7840-440b-8248-a0482760bd4b service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:31:26 user nova-compute[72793]: WARNING nova.compute.manager [req-1d1b4a1d-8e3c-477d-87c1-1f1c4743809c req-961cad53-7840-440b-8248-a0482760bd4b service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state stopped and task_state powering-on.
Aug 17 04:31:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26338346364356364', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338346364356364', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:31:26 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:31:26 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:31:26 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:31:26 user nova-compute[72793]:   <serial>d3e75864-24c7-405c-8657-e87f42191361</serial>
Aug 17 04:31:26 user nova-compute[72793]: </disk>
Aug 17 04:31:26 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:31:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] No VIF found with MAC fa:16:3e:77:c0:3c, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ed062e72-b16d-495e-b1c9-cb7e93844bba tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.100s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246688.9466202, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Resumed (Lifecycle Event)
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-42ee0bfb-581f-4341-ac9e-c11595052b1b req-af18d64f-0d53-4ae6-a474-9ed03430d69f service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-42ee0bfb-581f-4341-ac9e-c11595052b1b req-af18d64f-0d53-4ae6-a474-9ed03430d69f service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-42ee0bfb-581f-4341-ac9e-c11595052b1b req-af18d64f-0d53-4ae6-a474-9ed03430d69f service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-42ee0bfb-581f-4341-ac9e-c11595052b1b req-af18d64f-0d53-4ae6-a474-9ed03430d69f service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-42ee0bfb-581f-4341-ac9e-c11595052b1b req-af18d64f-0d53-4ae6-a474-9ed03430d69f service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:31:29 user nova-compute[72793]: WARNING nova.compute.manager [req-42ee0bfb-581f-4341-ac9e-c11595052b1b req-af18d64f-0d53-4ae6-a474-9ed03430d69f service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state stopped and task_state powering-on.
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance rebooted successfully.
Aug 17 04:31:29 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:31:29 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.31820297241211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ce0670a9-e9a6-4711-bafb-c3dab21bec07 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.compute.manager [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Detaching volume d3e75864-24c7-405c-8657-e87f42191361
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246688.9469137, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Started (Lifecycle Event)
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.virt.block_device [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Attempting to driver detach volume d3e75864-24c7-405c-8657-e87f42191361 from mountpoint /dev/vdb
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Attempting to detach device vdb from instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:31:29 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:31:29 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:31:29 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:31:29 user nova-compute[72793]:   <serial>d3e75864-24c7-405c-8657-e87f42191361</serial>
Aug 17 04:31:29 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:31:29 user nova-compute[72793]: </disk>
Aug 17 04:31:29 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully detached device vdb from instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f from the persistent domain config.
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:31:29 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:31:29 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:31:29 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:31:29 user nova-compute[72793]:   <serial>d3e75864-24c7-405c-8657-e87f42191361</serial>
Aug 17 04:31:29 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:31:29 user nova-compute[72793]: </disk>
Aug 17 04:31:29 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692246689.724127, 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:31:29 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully detached device vdb from instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f from the live domain config.
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UOIXwnBa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:31:29 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[76071a3f-50d8-424b-ba91-51970bd0087f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a068a-7994-40eb-abad-d87f5724b950]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 (non-flash)
Aug 17 04:31:29 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 (non-flash)
Aug 17 04:31:29 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98ace5d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c6144d-8433-4be5-9561-dc997209d858]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b844fccc-4502-45c9-8306-3b4eefeb7c72]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c01c0e-f787-4063-bc1a-db2946706442]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba358a61-ecf5-49d7-a40b-54b442f9276e]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb9ecd-e9bc-4f09-81b6-bb4a1dea69d0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f910f-a2f1-40fa-859b-24b64f5932c9]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260]
Aug 17 04:31:29 user nova-compute[72793]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361, portal: 172.16.0.220,3260] successful.
Aug 17 04:31:29 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e75864-24c7-405c-8657-e87f42191361 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b590902e-418c-4152-a995-5911d2d32386]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] <== disconnect_volume: return (250ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:31:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:31:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:30 user nova-compute[72793]: DEBUG nova.objects.instance [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'flavor' on Instance uuid 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-1bfd3709-060f-46a4-bce6-f82026c18410 tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:31:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:31:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:31:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [{"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-6a40379d-ca08-4b3e-95f6-61d93d529162" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:31:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:31:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:31:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:32:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:32:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:32:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:32:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:32:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:32:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:18 user nova-compute[72793]: INFO nova.compute.manager [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Terminating instance
Aug 17 04:32:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-da795884-ab9a-4d0c-8264-9cbc82c497d9 req-28f06b97-64f0-4309-9ecb-014450868ec9 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-vif-unplugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da795884-ab9a-4d0c-8264-9cbc82c497d9 req-28f06b97-64f0-4309-9ecb-014450868ec9 service nova] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da795884-ab9a-4d0c-8264-9cbc82c497d9 req-28f06b97-64f0-4309-9ecb-014450868ec9 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da795884-ab9a-4d0c-8264-9cbc82c497d9 req-28f06b97-64f0-4309-9ecb-014450868ec9 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-da795884-ab9a-4d0c-8264-9cbc82c497d9 req-28f06b97-64f0-4309-9ecb-014450868ec9 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] No waiting events found dispatching network-vif-unplugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-da795884-ab9a-4d0c-8264-9cbc82c497d9 req-28f06b97-64f0-4309-9ecb-014450868ec9 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-vif-unplugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Instance destroyed successfully.
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.objects.instance [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lazy-loading 'resources' on Instance uuid 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:29:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1967226500',display_name='tempest-AttachVolumeNegativeTest-server-1967226500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1967226500',id=43,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6IN7Glx/Tb7016By+rrKoDbE1Ufn5j8973inPgNyMcGWfKJHBwMmFkqHORqR1O9Zdva8Ni93MDM6ywXTtHMXo0TA5v835dM8c152qmGY+0+abft92T7KvP01BKuLczGQ==',key_name='tempest-keypair-1987562175',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:29:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12975ec6f4e740808d9bdd0be12181e7',ramdisk_id='',reservation_id='r-islvdf8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1865038023',owner_user_name='tempest-AttachVolumeNegativeTest-1865038023-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='621ab8c1ef2c4af2a0baf1390a22ff56',uuid=8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converting VIF {"id": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "address": "fa:16:3e:77:c0:3c", "network": {"id": "c6dd1aac-82cd-4e2e-a691-117a520664ad", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1587483646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12975ec6f4e740808d9bdd0be12181e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb37d50-ea", "ovs_interfaceid": "ffb37d50-ea97-4619-a5b6-932ca97f3c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG os_vif [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffb37d50-ea, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:19 user nova-compute[72793]: INFO os_vif [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:c0:3c,bridge_name='br-int',has_traffic_filtering=True,id=ffb37d50-ea97-4619-a5b6-932ca97f3c47,network=Network(c6dd1aac-82cd-4e2e-a691-117a520664ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb37d50-ea')
Aug 17 04:32:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Deleting instance files /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f_del
Aug 17 04:32:19 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Deletion of /opt/stack/data/nova/instances/8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f_del complete
Aug 17 04:32:19 user nova-compute[72793]: INFO nova.compute.manager [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 04:32:19 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:32:19 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:32:20 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:32:20 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Took 0.89 seconds to deallocate network for instance.
Aug 17 04:32:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:20 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:32:20 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:32:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:20 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Deleted allocations for instance 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f
Aug 17 04:32:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-cd4463b5-c5a0-4cf9-aa7c-c16593799d3e tempest-AttachVolumeNegativeTest-1865038023 tempest-AttachVolumeNegativeTest-1865038023-project-member] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:32:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] Acquiring lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] Lock "8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] No waiting events found dispatching network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:32:21 user nova-compute[72793]: WARNING nova.compute.manager [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received unexpected event network-vif-plugged-ffb37d50-ea97-4619-a5b6-932ca97f3c47 for instance with vm_state deleted and task_state None.
Aug 17 04:32:21 user nova-compute[72793]: DEBUG nova.compute.manager [req-2ba510d9-a743-41d3-a4f9-68073116b49e req-052549b3-3232-4cc5-a332-4ffc8fbf5506 service nova] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Received event network-vif-deleted-ffb37d50-ea97-4619-a5b6-932ca97f3c47 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:32:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:25 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:32:26 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:32:26 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:32:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=25.34451675415039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:32:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:32:34 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246739.5503817, 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:32:34 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] VM Stopped (Lifecycle Event)
Aug 17 04:32:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-f5e97813-9266-4165-a7df-13ad45340b9e None None] [instance: 8b8fa7e4-b901-4425-9de2-5e6e1e8c3b8f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:32:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:32:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:32:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:32:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:32:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Verify base images {{(pid=72793) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Image id 5f4b4804-03ee-46d6-a29f-d5a8a50dfc98 yields fingerprint 3df7d9af4f394f5236ffd9fec8b98b6b6d61265d {{(pid=72793) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] image 5f4b4804-03ee-46d6-a29f-d5a8a50dfc98 at (/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d): checking
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] image 5f4b4804-03ee-46d6-a29f-d5a8a50dfc98 at (/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d): image is in use {{(pid=72793) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72793) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] 6a40379d-ca08-4b3e-95f6-61d93d529162 is a valid instance name {{(pid=72793) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] 6a40379d-ca08-4b3e-95f6-61d93d529162 has a disk file {{(pid=72793) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 6a40379d-ca08-4b3e-95f6-61d93d529162 is backed by 3df7d9af4f394f5236ffd9fec8b98b6b6d61265d {{(pid=72793) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3
Aug 17 04:32:56 user nova-compute[72793]: WARNING nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Unknown base file: /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Active base files: /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Removable base files: /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803 /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1 /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483 /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238 /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3 /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/68e594c7c2a62e2961b3f51d39dcc49cccb10e2e
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9131746a2708112874bba893dec81b6b545dd803
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1dd387cb2b41eb8bdc4580649561b19731aba7b1
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d0afb77ce0cb406eab6b7e481792c905669c483
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0fc64d3c03e5d76ee2d2d26d47a2c5ccf4d5dbda
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04657f02b81f36f3e18cf1db38bf3ef056e3e238
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1194b9fedf5bf44925e9b6c2495b2bc1f23e3c7a
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b44d1d23b38484cc92e788defddd3fe2009bff3
Aug 17 04:32:56 user nova-compute[72793]: INFO nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/61704a03535e68382bf4d2fb9b5209afe072677e
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Verification complete {{(pid=72793) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Verify swap images {{(pid=72793) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 04:32:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.imagecache [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Verify ephemeral images {{(pid=72793) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 04:32:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:14 user nova-compute[72793]: INFO nova.compute.manager [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Terminating instance
Aug 17 04:33:14 user nova-compute[72793]: DEBUG nova.compute.manager [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-7970398b-314b-48b8-b25f-d73e94f6c09f req-c9ea7f93-5e23-4089-9879-c2b02fe4c4bd service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7970398b-314b-48b8-b25f-d73e94f6c09f req-c9ea7f93-5e23-4089-9879-c2b02fe4c4bd service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7970398b-314b-48b8-b25f-d73e94f6c09f req-c9ea7f93-5e23-4089-9879-c2b02fe4c4bd service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7970398b-314b-48b8-b25f-d73e94f6c09f req-c9ea7f93-5e23-4089-9879-c2b02fe4c4bd service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-7970398b-314b-48b8-b25f-d73e94f6c09f req-c9ea7f93-5e23-4089-9879-c2b02fe4c4bd service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:33:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-7970398b-314b-48b8-b25f-d73e94f6c09f req-c9ea7f93-5e23-4089-9879-c2b02fe4c4bd service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-unplugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:15 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Instance destroyed successfully.
Aug 17 04:33:15 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'resources' on Instance uuid 6a40379d-ca08-4b3e-95f6-61d93d529162 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:23:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1580509719',display_name='tempest-AttachVolumeTestJSON-server-1580509719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1580509719',id=41,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjuukrIZ8Qi4JsqTCMugCG5fLxX2KSPN5ERYfz0ZtuDrR95cMA1dt5CpPiourhWJp8zZLqq9iUiuyfgGWqMIuaAgFCaB3nQ4Z9AxEaviM2nnBRZrkItovENFIh/giA2dA==',key_name='tempest-keypair-835842564',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-89hgaapf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=6a40379d-ca08-4b3e-95f6-61d93d529162,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "address": "fa:16:3e:f5:c0:2d", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3851205d-1f", "ovs_interfaceid": "3851205d-1f2c-48b0-b097-b172f3b5ace9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG os_vif [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3851205d-1f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:15 user nova-compute[72793]: INFO os_vif [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c0:2d,bridge_name='br-int',has_traffic_filtering=True,id=3851205d-1f2c-48b0-b097-b172f3b5ace9,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3851205d-1f')
Aug 17 04:33:15 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Deleting instance files /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162_del
Aug 17 04:33:15 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Deletion of /opt/stack/data/nova/instances/6a40379d-ca08-4b3e-95f6-61d93d529162_del complete
Aug 17 04:33:15 user nova-compute[72793]: INFO nova.compute.manager [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 04:33:15 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:33:15 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:33:16 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Took 0.90 seconds to deallocate network for instance.
Aug 17 04:33:16 user nova-compute[72793]: DEBUG nova.compute.manager [req-eb336a27-a413-4e34-b0ac-d940741fd1da req-bf8e2bed-6cc4-4923-96dc-ac1fa4a08467 service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-deleted-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:33:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:16 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Deleted allocations for instance 6a40379d-ca08-4b3e-95f6-61d93d529162
Aug 17 04:33:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e92e2f63-86ed-45f1-aa7e-8e1dd1014b3c tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-44c6f9fb-ec49-47f0-a6b8-e1accb1f0e32 req-1d123fd2-02e5-4e63-92b9-4eb60953f5ec service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:33:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-44c6f9fb-ec49-47f0-a6b8-e1accb1f0e32 req-1d123fd2-02e5-4e63-92b9-4eb60953f5ec service nova] Acquiring lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-44c6f9fb-ec49-47f0-a6b8-e1accb1f0e32 req-1d123fd2-02e5-4e63-92b9-4eb60953f5ec service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-44c6f9fb-ec49-47f0-a6b8-e1accb1f0e32 req-1d123fd2-02e5-4e63-92b9-4eb60953f5ec service nova] Lock "6a40379d-ca08-4b3e-95f6-61d93d529162-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-44c6f9fb-ec49-47f0-a6b8-e1accb1f0e32 req-1d123fd2-02e5-4e63-92b9-4eb60953f5ec service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] No waiting events found dispatching network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:33:17 user nova-compute[72793]: WARNING nova.compute.manager [req-44c6f9fb-ec49-47f0-a6b8-e1accb1f0e32 req-1d123fd2-02e5-4e63-92b9-4eb60953f5ec service nova] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Received unexpected event network-vif-plugged-3851205d-1f2c-48b0-b097-b172f3b5ace9 for instance with vm_state deleted and task_state None.
Aug 17 04:33:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:33:26 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:33:26 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=25.37164306640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:33:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:33:27 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:33:29 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:30 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692246795.4846294, 6a40379d-ca08-4b3e-95f6-61d93d529162 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:33:30 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] VM Stopped (Lifecycle Event)
Aug 17 04:33:30 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4e71c497-aa35-4713-9fd8-c85e3d6d1e9c None None] [instance: 6a40379d-ca08-4b3e-95f6-61d93d529162] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:33:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:31 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:34 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:33:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:33:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:33:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:33:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:33:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:33:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:34:08 user nova-compute[72793]: INFO nova.compute.claims [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Claim successful on node user
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.173s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:34:08 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:34:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:34:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Creating image(s)
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "/opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "/opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "/opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.policy [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302b737fd798432683e98f2c60b76b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '863a28bd4f24493fa848df117d9edac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.185s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk 1073741824" returned: 0 in 0.053s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Cannot resize image /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'migration_context' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Ensure instance console log exists: /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Successfully created port: 59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:34:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Successfully updated port: 59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquired lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-changed-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Refreshing instance network info cache due to event network-changed-59daf1d6-f8c0-40f9-96d1-63c3aa753196. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] Acquiring lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating instance_info_cache with network_info: [{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Releasing lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Instance network_info: |[{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] Acquired lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Refreshing network info cache for port 59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Start _get_guest_xml network_info=[{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:34:11 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:34:11 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-623114912',display_name='tempest-AttachVolumeTestJSON-server-623114912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-623114912',id=44,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJx+674o055pY3+JOS2ACpYUzSvWw4iRa4fjHjHnnGoODNPBI0sCVeifPNRIINAapZpAObqC8ls5TD+O/Dqk4sTG8coESQ+KqK5Cy1b6v6woOebyvBk6ngyo/x5GiSCAw==',key_name='tempest-keypair-453903614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-s9khzczj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=f265523f-b190-417b-a14f-de23ca190cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'pci_devices' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:34:11 user nova-compute[72793]:   <uuid>f265523f-b190-417b-a14f-de23ca190cf9</uuid>
Aug 17 04:34:11 user nova-compute[72793]:   <name>instance-0000002c</name>
Aug 17 04:34:11 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:34:11 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:34:11 user nova-compute[72793]:   <metadata>
Aug 17 04:34:11 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:34:11 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:34:11 user nova-compute[72793]:       <nova:name>tempest-AttachVolumeTestJSON-server-623114912</nova:name>
Aug 17 04:34:11 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:34:11</nova:creationTime>
Aug 17 04:34:11 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:34:11 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:34:11 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:34:11 user nova-compute[72793]:       <nova:owner>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:user uuid="302b737fd798432683e98f2c60b76b71">tempest-AttachVolumeTestJSON-769655846-project-member</nova:user>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:project uuid="863a28bd4f24493fa848df117d9edac7">tempest-AttachVolumeTestJSON-769655846</nova:project>
Aug 17 04:34:11 user nova-compute[72793]:       </nova:owner>
Aug 17 04:34:11 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:34:11 user nova-compute[72793]:       <nova:ports>
Aug 17 04:34:11 user nova-compute[72793]:         <nova:port uuid="59daf1d6-f8c0-40f9-96d1-63c3aa753196">
Aug 17 04:34:11 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 04:34:11 user nova-compute[72793]:         </nova:port>
Aug 17 04:34:11 user nova-compute[72793]:       </nova:ports>
Aug 17 04:34:11 user nova-compute[72793]:     </nova:instance>
Aug 17 04:34:11 user nova-compute[72793]:   </metadata>
Aug 17 04:34:11 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:34:11 user nova-compute[72793]:     <system>
Aug 17 04:34:11 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:34:11 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:34:11 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:34:11 user nova-compute[72793]:       <entry name="serial">f265523f-b190-417b-a14f-de23ca190cf9</entry>
Aug 17 04:34:11 user nova-compute[72793]:       <entry name="uuid">f265523f-b190-417b-a14f-de23ca190cf9</entry>
Aug 17 04:34:11 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:34:11 user nova-compute[72793]:     </system>
Aug 17 04:34:11 user nova-compute[72793]:   </sysinfo>
Aug 17 04:34:11 user nova-compute[72793]:   <os>
Aug 17 04:34:11 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:34:11 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:34:11 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:34:11 user nova-compute[72793]:   </os>
Aug 17 04:34:11 user nova-compute[72793]:   <features>
Aug 17 04:34:11 user nova-compute[72793]:     <acpi/>
Aug 17 04:34:11 user nova-compute[72793]:     <apic/>
Aug 17 04:34:11 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:34:11 user nova-compute[72793]:   </features>
Aug 17 04:34:11 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:34:11 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:34:11 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:34:11 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:34:11 user nova-compute[72793]:   </clock>
Aug 17 04:34:11 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:34:11 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:34:11 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:34:11 user nova-compute[72793]:   </cpu>
Aug 17 04:34:11 user nova-compute[72793]:   <devices>
Aug 17 04:34:11 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:34:11 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:34:11 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk"/>
Aug 17 04:34:11 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:34:11 user nova-compute[72793]:     </disk>
Aug 17 04:34:11 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:34:11 user nova-compute[72793]:       <mac address="fa:16:3e:7d:5d:7a"/>
Aug 17 04:34:11 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:34:11 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:34:11 user nova-compute[72793]:       <target dev="tap59daf1d6-f8"/>
Aug 17 04:34:11 user nova-compute[72793]:     </interface>
Aug 17 04:34:11 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:34:11 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/console.log" append="off"/>
Aug 17 04:34:11 user nova-compute[72793]:     </serial>
Aug 17 04:34:11 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:34:11 user nova-compute[72793]:     <video>
Aug 17 04:34:11 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:34:11 user nova-compute[72793]:     </video>
Aug 17 04:34:11 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:34:11 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:34:11 user nova-compute[72793]:     </rng>
Aug 17 04:34:11 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:34:11 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:34:11 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:34:11 user nova-compute[72793]:     </memballoon>
Aug 17 04:34:11 user nova-compute[72793]:   </devices>
Aug 17 04:34:11 user nova-compute[72793]: </domain>
Aug 17 04:34:11 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-623114912',display_name='tempest-AttachVolumeTestJSON-server-623114912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-623114912',id=44,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJx+674o055pY3+JOS2ACpYUzSvWw4iRa4fjHjHnnGoODNPBI0sCVeifPNRIINAapZpAObqC8ls5TD+O/Dqk4sTG8coESQ+KqK5Cy1b6v6woOebyvBk6ngyo/x5GiSCAw==',key_name='tempest-keypair-453903614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-s9khzczj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=f265523f-b190-417b-a14f-de23ca190cf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG os_vif [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59daf1d6-f8, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59daf1d6-f8, col_values=(('external_ids', {'iface-id': '59daf1d6-f8c0-40f9-96d1-63c3aa753196', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:5d:7a', 'vm-uuid': 'f265523f-b190-417b-a14f-de23ca190cf9'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:11 user nova-compute[72793]: INFO os_vif [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8')
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No VIF found with MAC fa:16:3e:7d:5d:7a, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updated VIF entry in instance network info cache for port 59daf1d6-f8c0-40f9-96d1-63c3aa753196. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG nova.network.neutron [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating instance_info_cache with network_info: [{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:34:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-da30c29a-c290-4523-968d-e4f5ad09c403 req-f8b1e4a4-798e-418b-b264-4d6cb99441eb service nova] Releasing lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:34:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-f9bd5483-671e-4d24-98de-37381fec5b17 req-ddaaa07d-09ee-43f3-ae2a-29d36737d3c9 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f9bd5483-671e-4d24-98de-37381fec5b17 req-ddaaa07d-09ee-43f3-ae2a-29d36737d3c9 service nova] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f9bd5483-671e-4d24-98de-37381fec5b17 req-ddaaa07d-09ee-43f3-ae2a-29d36737d3c9 service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f9bd5483-671e-4d24-98de-37381fec5b17 req-ddaaa07d-09ee-43f3-ae2a-29d36737d3c9 service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-f9bd5483-671e-4d24-98de-37381fec5b17 req-ddaaa07d-09ee-43f3-ae2a-29d36737d3c9 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] No waiting events found dispatching network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:34:13 user nova-compute[72793]: WARNING nova.compute.manager [req-f9bd5483-671e-4d24-98de-37381fec5b17 req-ddaaa07d-09ee-43f3-ae2a-29d36737d3c9 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received unexpected event network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 for instance with vm_state building and task_state spawning.
Aug 17 04:34:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246855.03415, f265523f-b190-417b-a14f-de23ca190cf9 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] VM Resumed (Lifecycle Event)
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Instance spawned successfully.
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246855.0355408, f265523f-b190-417b-a14f-de23ca190cf9 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] VM Started (Lifecycle Event)
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:34:15 user nova-compute[72793]: INFO nova.compute.manager [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Took 6.61 seconds to build instance.
Aug 17 04:34:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9fe5d13-8fb9-4031-ad15-adf51506f554 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.704s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-ed445220-b60f-4405-bc20-dc7399d5859c req-1ea5273e-2257-4ff1-9ef5-e657fac91455 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ed445220-b60f-4405-bc20-dc7399d5859c req-1ea5273e-2257-4ff1-9ef5-e657fac91455 service nova] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ed445220-b60f-4405-bc20-dc7399d5859c req-1ea5273e-2257-4ff1-9ef5-e657fac91455 service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ed445220-b60f-4405-bc20-dc7399d5859c req-1ea5273e-2257-4ff1-9ef5-e657fac91455 service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-ed445220-b60f-4405-bc20-dc7399d5859c req-1ea5273e-2257-4ff1-9ef5-e657fac91455 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] No waiting events found dispatching network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:34:15 user nova-compute[72793]: WARNING nova.compute.manager [req-ed445220-b60f-4405-bc20-dc7399d5859c req-1ea5273e-2257-4ff1-9ef5-e657fac91455 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received unexpected event network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 for instance with vm_state active and task_state None.
Aug 17 04:34:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:21 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:34:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:26 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:34:27 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:34:27 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:34:27 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=25.368427276611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:34:27 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance f265523f-b190-417b-a14f-de23ca190cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:34:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:34:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:36 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:34:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:34:37 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating instance_info_cache with network_info: [{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:34:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:34:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:06 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:35:06 user nova-compute[72793]: INFO nova.compute.claims [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Claim successful on node user
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:35:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:35:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:35:07 user nova-compute[72793]: INFO nova.virt.block_device [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Booting with volume snapshot e10382a3-08d3-4c2d-a2d8-1a9d346e492e at /dev/vda
Aug 17 04:35:07 user nova-compute[72793]: DEBUG nova.policy [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ac4e1570914524a592a7a67453bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d3627ce05643749885c08563fbe747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Successfully created port: eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Successfully updated port: eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquired lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-changed-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Refreshing instance network info cache due to event network-changed-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:35:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] Acquiring lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG nova.network.neutron [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updating instance_info_cache with network_info: [{"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Releasing lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Instance network_info: |[{"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] Acquired lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Refreshing network info cache for port eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updated VIF entry in instance network info cache for port eeb3c4a4-881d-4b76-bbfd-58dad45b38ac. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG nova.network.neutron [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updating instance_info_cache with network_info: [{"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:35:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-09733f15-3c29-45fe-b2a7-af6656473516 req-85c4733c-4250-478d-8b64-1e9b80e81ef0 service nova] Releasing lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:35:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG os_brick.utils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6846044-443d-4ac3-95f1-be939b99128e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[81190a04-ef7f-498e-94b1-d0f67c7c1624]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee02efd-4fc2-423c-8e8a-f60ed420937d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f3b1cc-7015-408d-8e83-ebc6d9ae4eb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:35:13 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:35:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5c174-79ad-4699-bf69-801d17fe3ab1]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG os_brick.utils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:35:13 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updating existing volume attachment record: cdab5668-7457-457b-9e04-88387b0d5b8c {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:35:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:35:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:35:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:35:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:35:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:35:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:35:23 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Creating image(s)
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Ensure instance console log exists: /opt/stack/data/nova/instances/d62c1839-9d1a-4537-9e18-5f9f34808c1a/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Start _get_guest_xml network_info=[{"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXDszbkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd62c1839-9d1a-4537-9e18-5f9f34808c1a', 'attached_at': '', 'detached_at': '', 'volume_id': '3be9ff51-114a-40c7-ad82-ee9d43b431c3', 'serial': '3be9ff51-114a-40c7-ad82-ee9d43b431c3'}, 'guest_format': None, 'attachment_id': 'cdab5668-7457-457b-9e04-88387b0d5b8c', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:35:23 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:35:23 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXDszbkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:35:23 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:35:23 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:35:23 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d443bd-5ca2-40aa-9e4a-35969aa979c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:35:23 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b331c4b4-a5f1-4c5b-9948-99f5bfe888bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3] added
Aug 17 04:35:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516e090-8f08-4d7e-be93-c727721caccf]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836b0a0-991e-436d-9cee-af9ac90e736c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXDszbkC {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXDszbkC" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d6611-daec-4e01-a80a-b35f42896f48]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wXDszbkC'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a2b9f1-b630-4542-ae4a-013691dd4c71]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858e98f-3df6-40d3-9695-2fd916795baf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:35:23 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:35:23 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:35:23 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:35:23 user nova-compute[72793]: 
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[023223c8-b2f4-4b8d-be54-080fcd67608d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260]
Aug 17 04:35:23 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260] successful.
Aug 17 04:35:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7037157b-655a-4a27-a276-4c78dfe79b26]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eca2bd-ba0a-4b59-9c31-f91eba2fc0ae]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:35:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:35:23 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e850ac3c-70b7-48e8-a3e7-ef6a4f3c0191]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:35:23 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXDszbkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23231363238346632', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231363238346632', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-495689762',display_name='tempest-TestVolumeBootPattern-server-495689762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-495689762',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-q0r9a03b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:35:07Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=d62c1839-9d1a-4537-9e18-5f9f34808c1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'pci_devices' on Instance uuid d62c1839-9d1a-4537-9e18-5f9f34808c1a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:35:24 user nova-compute[72793]:   <uuid>d62c1839-9d1a-4537-9e18-5f9f34808c1a</uuid>
Aug 17 04:35:24 user nova-compute[72793]:   <name>instance-0000002d</name>
Aug 17 04:35:24 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:35:24 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:35:24 user nova-compute[72793]:   <metadata>
Aug 17 04:35:24 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:35:24 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:35:24 user nova-compute[72793]:       <nova:name>tempest-TestVolumeBootPattern-server-495689762</nova:name>
Aug 17 04:35:24 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:35:23</nova:creationTime>
Aug 17 04:35:24 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:35:24 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:35:24 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:35:24 user nova-compute[72793]:       <nova:owner>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:user uuid="a0ac4e1570914524a592a7a67453bcc3">tempest-TestVolumeBootPattern-2127448763-project-member</nova:user>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:project uuid="f6d3627ce05643749885c08563fbe747">tempest-TestVolumeBootPattern-2127448763</nova:project>
Aug 17 04:35:24 user nova-compute[72793]:       </nova:owner>
Aug 17 04:35:24 user nova-compute[72793]:       <nova:ports>
Aug 17 04:35:24 user nova-compute[72793]:         <nova:port uuid="eeb3c4a4-881d-4b76-bbfd-58dad45b38ac">
Aug 17 04:35:24 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 04:35:24 user nova-compute[72793]:         </nova:port>
Aug 17 04:35:24 user nova-compute[72793]:       </nova:ports>
Aug 17 04:35:24 user nova-compute[72793]:     </nova:instance>
Aug 17 04:35:24 user nova-compute[72793]:   </metadata>
Aug 17 04:35:24 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:35:24 user nova-compute[72793]:     <system>
Aug 17 04:35:24 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:35:24 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:35:24 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:35:24 user nova-compute[72793]:       <entry name="serial">d62c1839-9d1a-4537-9e18-5f9f34808c1a</entry>
Aug 17 04:35:24 user nova-compute[72793]:       <entry name="uuid">d62c1839-9d1a-4537-9e18-5f9f34808c1a</entry>
Aug 17 04:35:24 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:35:24 user nova-compute[72793]:     </system>
Aug 17 04:35:24 user nova-compute[72793]:   </sysinfo>
Aug 17 04:35:24 user nova-compute[72793]:   <os>
Aug 17 04:35:24 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:35:24 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:35:24 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:35:24 user nova-compute[72793]:   </os>
Aug 17 04:35:24 user nova-compute[72793]:   <features>
Aug 17 04:35:24 user nova-compute[72793]:     <acpi/>
Aug 17 04:35:24 user nova-compute[72793]:     <apic/>
Aug 17 04:35:24 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:35:24 user nova-compute[72793]:   </features>
Aug 17 04:35:24 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:35:24 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:35:24 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:35:24 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:35:24 user nova-compute[72793]:   </clock>
Aug 17 04:35:24 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:35:24 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:35:24 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:35:24 user nova-compute[72793]:   </cpu>
Aug 17 04:35:24 user nova-compute[72793]:   <devices>
Aug 17 04:35:24 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:35:24 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:35:24 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:35:24 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:35:24 user nova-compute[72793]:       <serial>3be9ff51-114a-40c7-ad82-ee9d43b431c3</serial>
Aug 17 04:35:24 user nova-compute[72793]:     </disk>
Aug 17 04:35:24 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:35:24 user nova-compute[72793]:       <mac address="fa:16:3e:f7:b8:90"/>
Aug 17 04:35:24 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:35:24 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:35:24 user nova-compute[72793]:       <target dev="tapeeb3c4a4-88"/>
Aug 17 04:35:24 user nova-compute[72793]:     </interface>
Aug 17 04:35:24 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:35:24 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d62c1839-9d1a-4537-9e18-5f9f34808c1a/console.log" append="off"/>
Aug 17 04:35:24 user nova-compute[72793]:     </serial>
Aug 17 04:35:24 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:35:24 user nova-compute[72793]:     <video>
Aug 17 04:35:24 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:35:24 user nova-compute[72793]:     </video>
Aug 17 04:35:24 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:35:24 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:35:24 user nova-compute[72793]:     </rng>
Aug 17 04:35:24 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:35:24 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:35:24 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:35:24 user nova-compute[72793]:     </memballoon>
Aug 17 04:35:24 user nova-compute[72793]:   </devices>
Aug 17 04:35:24 user nova-compute[72793]: </domain>
Aug 17 04:35:24 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-495689762',display_name='tempest-TestVolumeBootPattern-server-495689762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-495689762',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-q0r9a03b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:35:07Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=d62c1839-9d1a-4537-9e18-5f9f34808c1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG os_vif [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb3c4a4-88, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeb3c4a4-88, col_values=(('external_ids', {'iface-id': 'eeb3c4a4-881d-4b76-bbfd-58dad45b38ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:b8:90', 'vm-uuid': 'd62c1839-9d1a-4537-9e18-5f9f34808c1a'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:24 user nova-compute[72793]: INFO os_vif [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88')
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:35:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No VIF found with MAC fa:16:3e:f7:b8:90, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:35:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-4dbf9cb1-22a2-4130-99a7-72faf6a64f97 req-c520186a-c5ec-4e4a-805a-b33f36851f76 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:35:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4dbf9cb1-22a2-4130-99a7-72faf6a64f97 req-c520186a-c5ec-4e4a-805a-b33f36851f76 service nova] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4dbf9cb1-22a2-4130-99a7-72faf6a64f97 req-c520186a-c5ec-4e4a-805a-b33f36851f76 service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4dbf9cb1-22a2-4130-99a7-72faf6a64f97 req-c520186a-c5ec-4e4a-805a-b33f36851f76 service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-4dbf9cb1-22a2-4130-99a7-72faf6a64f97 req-c520186a-c5ec-4e4a-805a-b33f36851f76 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] No waiting events found dispatching network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:35:26 user nova-compute[72793]: WARNING nova.compute.manager [req-4dbf9cb1-22a2-4130-99a7-72faf6a64f97 req-c520186a-c5ec-4e4a-805a-b33f36851f76 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received unexpected event network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac for instance with vm_state building and task_state spawning.
Aug 17 04:35:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246927.8550642, d62c1839-9d1a-4537-9e18-5f9f34808c1a => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:35:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] VM Resumed (Lifecycle Event)
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:35:27 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Instance spawned successfully.
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:35:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692246927.8605402, d62c1839-9d1a-4537-9e18-5f9f34808c1a => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:35:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] VM Started (Lifecycle Event)
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:35:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:35:27 user nova-compute[72793]: INFO nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 17 04:35:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:35:28 user nova-compute[72793]: INFO nova.compute.manager [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Took 21.26 seconds to build instance.
Aug 17 04:35:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-8c745f42-9fbf-4b5d-b3ae-0c92e228d830 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.356s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-2a8b3722-a001-4949-aec6-3678b402c241 req-83dc8460-9cf4-4649-8a29-f1c43c3aa52f service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:35:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2a8b3722-a001-4949-aec6-3678b402c241 req-83dc8460-9cf4-4649-8a29-f1c43c3aa52f service nova] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2a8b3722-a001-4949-aec6-3678b402c241 req-83dc8460-9cf4-4649-8a29-f1c43c3aa52f service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2a8b3722-a001-4949-aec6-3678b402c241 req-83dc8460-9cf4-4649-8a29-f1c43c3aa52f service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-2a8b3722-a001-4949-aec6-3678b402c241 req-83dc8460-9cf4-4649-8a29-f1c43c3aa52f service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] No waiting events found dispatching network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:35:28 user nova-compute[72793]: WARNING nova.compute.manager [req-2a8b3722-a001-4949-aec6-3678b402c241 req-83dc8460-9cf4-4649-8a29-f1c43c3aa52f service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received unexpected event network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac for instance with vm_state active and task_state None.
Aug 17 04:35:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:29 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:35:29 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:35:29 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.329883575439453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:35:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance f265523f-b190-417b-a14f-de23ca190cf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d62c1839-9d1a-4537-9e18-5f9f34808c1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:35:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:35:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:35:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:35:39 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating instance_info_cache with network_info: [{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:35:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:35:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:35:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:35:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-changed-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:35:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Refreshing instance network info cache due to event network-changed-59daf1d6-f8c0-40f9-96d1-63c3aa753196. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:35:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] Acquiring lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:35:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] Acquired lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:35:59 user nova-compute[72793]: DEBUG nova.network.neutron [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Refreshing network info cache for port 59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:36:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updated VIF entry in instance network info cache for port 59daf1d6-f8c0-40f9-96d1-63c3aa753196. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:36:00 user nova-compute[72793]: DEBUG nova.network.neutron [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating instance_info_cache with network_info: [{"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:36:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-2eddfdc8-0961-458b-98b9-b644fd3e4535 req-cdd69271-6ac3-4ac5-a408-b30680563787 service nova] Releasing lock "refresh_cache-f265523f-b190-417b-a14f-de23ca190cf9" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:36:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:04 user nova-compute[72793]: INFO nova.compute.manager [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attaching volume f979c9d3-508a-4be0-ab88-c5e3df98baf3 to /dev/vdb
Aug 17 04:36:04 user nova-compute[72793]: DEBUG os_brick.utils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26331d2-d879-4a74-a525-8cc9b843a028]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6cbec0-a62f-4f90-8b4d-0a62bd542934]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d044e-4442-43f2-9024-df7000f3590a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce846656-22ec-4cb3-806d-4718b4b04527]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:36:04 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:36:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a48a646-f703-4473-9220-bd3ef3f7ac44]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG os_brick.utils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:04 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating existing volume attachment record: 9f7d1716-27ab-43c4-8f7e-a8bc9b643c49 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:36:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHkNbxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:14 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:14 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1a6b6-4f65-4a43-a831-a601c4bf469f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:36:14 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbdd3a2-e9f9-42fc-a117-e28ca5c8c40d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3] added
Aug 17 04:36:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8350795-9a01-4c2a-a0ad-26b02a79d393]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[529c30ce-eefd-4cb3-b8e8-bba0d8d3d6cc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHkNbxdt {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qHkNbxdt" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef0ab2-a363-48d6-add6-c39ded688ad0]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qHkNbxdt'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e32311-85e5-42fe-a87e-de48c6e3747a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbaefce-ffb4-4182-b4bc-b5349c0b5fdc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:14 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:14 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fc6db4-47af-4116-883f-22b27d5d4d30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260]
Aug 17 04:36:15 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260] successful.
Aug 17 04:36:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55a805-0f5b-4e8b-a3cb-5c0454200dab]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff8ab9-0978-417b-91d9-26d434746066]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:15 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:15 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:15 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fcfdb-338f-4597-903a-405c7fc4b76b]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:15 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHkNbxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23231353430353638', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231353430353638', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:36:16 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:36:16 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:36:16 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:36:16 user nova-compute[72793]:   <serial>f979c9d3-508a-4be0-ab88-c5e3df98baf3</serial>
Aug 17 04:36:16 user nova-compute[72793]: </disk>
Aug 17 04:36:16 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No VIF found with MAC fa:16:3e:7d:5d:7a, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:36:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c049b4e8-9674-4acf-8c66-6cf69e832f20 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.971s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:22 user nova-compute[72793]: INFO nova.compute.manager [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attaching volume 1775e847-e7c0-4c7b-bed9-33a61927b33e to /dev/vdc
Aug 17 04:36:22 user nova-compute[72793]: DEBUG os_brick.utils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[feadef4f-4da6-4c66-9e05-63793ab7c44b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[687b3264-3d02-4265-b20c-d3066684b67c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f26eb-bd68-421f-9d72-0cbdef7c70f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[364334ea-ee63-4526-b807-23337348ab2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:36:22 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:36:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1f690-193d-4cc4-af04-ee32f688e858]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG os_brick.utils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:22 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating existing volume attachment record: a6670793-ba6d-481b-a890-f159bdd977e0 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:36:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:36:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:30 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:36:31 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:36:31 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:36:31 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=25.328609466552734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:31 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance f265523f-b190-417b-a14f-de23ca190cf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d62c1839-9d1a-4537-9e18-5f9f34808c1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:36:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odBJIXbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:33 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:33 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:33 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaec2e92-c672-41d5-93c1-bcb87c8cd64e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:36:33 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f739ae-9308-4cd5-9897-fc944455b4fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e] added
Aug 17 04:36:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bece986-74b4-4522-8f59-ced0e5d2f94b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97f956-ef12-419f-805d-3638e34e6e55]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odBJIXbn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odBJIXbn" returned: 0 in 0.034s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6636c4-70cc-4b7b-85a9-fee30ba880ab]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odBJIXbn'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[258520c1-4aed-4347-8622-5c447478f001]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5629cd22-5f65-4176-9aac-667bfc9bf949]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7aa606-5460-4d05-9a37-23b10e6829be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260]
Aug 17 04:36:33 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260] successful.
Aug 17 04:36:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a192852-34c0-4a23-9a35-8262f703c817]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6265bb-3906-4dd9-9000-608435e01b71]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)
Aug 17 04:36:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:33 user nova-compute[72793]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)
Aug 17 04:36:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[70269f45-0360-4465-b56b-1dafdc028a8c]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odBJIXbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23039353666336664', 'path': '/dev/sdd'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039353666336664', 'path': '/dev/sdd'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.objects.instance [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:36:34 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:36:34 user nova-compute[72793]:   <source dev="/dev/sdd"/>
Aug 17 04:36:34 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:36:34 user nova-compute[72793]:   <serial>1775e847-e7c0-4c7b-bed9-33a61927b33e</serial>
Aug 17 04:36:34 user nova-compute[72793]: </disk>
Aug 17 04:36:34 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:36:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] No VIF found with MAC fa:16:3e:7d:5d:7a, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-4df11f99-334b-498e-8099-5c64ec6a9615 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.643s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:35 user nova-compute[72793]: INFO nova.compute.manager [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Detaching volume f979c9d3-508a-4be0-ab88-c5e3df98baf3
Aug 17 04:36:35 user nova-compute[72793]: INFO nova.virt.block_device [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attempting to driver detach volume f979c9d3-508a-4be0-ab88-c5e3df98baf3 from mountpoint /dev/vdb
Aug 17 04:36:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Attempting to detach device vdb from instance f265523f-b190-417b-a14f-de23ca190cf9 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:36:35 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:36:35 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:36:35 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:36:35 user nova-compute[72793]:   <serial>f979c9d3-508a-4be0-ab88-c5e3df98baf3</serial>
Aug 17 04:36:35 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:36:35 user nova-compute[72793]: </disk>
Aug 17 04:36:35 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:36:35 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully detached device vdb from instance f265523f-b190-417b-a14f-de23ca190cf9 from the persistent domain config.
Aug 17 04:36:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f265523f-b190-417b-a14f-de23ca190cf9 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:36:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:36:35 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:36:35 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:36:35 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:36:35 user nova-compute[72793]:   <serial>f979c9d3-508a-4be0-ab88-c5e3df98baf3</serial>
Aug 17 04:36:35 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:36:35 user nova-compute[72793]: </disk>
Aug 17 04:36:35 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692246996.3503609, f265523f-b190-417b-a14f-de23ca190cf9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:36:36 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully detached device vdb from instance f265523f-b190-417b-a14f-de23ca190cf9 from the live domain config.
Aug 17 04:36:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qHkNbxdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:36 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff77e0e-2c77-4f0d-b586-54fe0d24e4b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb001bf-bde0-4d3b-a8e0-d4727541dd91]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:36 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:36 user nova-compute[72793]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)
Aug 17 04:36:36 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:36 user nova-compute[72793]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 (non-flash)
Aug 17 04:36:36 user nova-compute[72793]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)
Aug 17 04:36:36 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0266320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6de00a-7138-49cb-98ff-e4e23313e24b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ddf6a6-f9d5-462a-8ddd-9675c87af6c0]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8979da-e8ee-4d2a-a850-4d0c33c960f3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0971c-205c-4072-97ea-e1ede89ddb87]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e527ea2-d13d-4441-bfe0-3393b6ede891]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6db1df8-b7a1-47fa-b018-0b6608307eb0]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260]
Aug 17 04:36:36 user nova-compute[72793]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3, portal: 172.16.0.220,3260] successful.
Aug 17 04:36:36 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f979c9d3-508a-4be0-ab88-c5e3df98baf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2bb264-b65e-44f0-acff-f7db7a3023be]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== disconnect_volume: return (289ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:36:37 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c0dcf946-d739-4976-abec-ec3fcd08b088 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.727s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:38 user nova-compute[72793]: INFO nova.compute.manager [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Detaching volume 1775e847-e7c0-4c7b-bed9-33a61927b33e
Aug 17 04:36:38 user nova-compute[72793]: INFO nova.virt.block_device [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Attempting to driver detach volume 1775e847-e7c0-4c7b-bed9-33a61927b33e from mountpoint /dev/vdc
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Attempting to detach device vdc from instance f265523f-b190-417b-a14f-de23ca190cf9 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:36:38 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:36:38 user nova-compute[72793]:   <source dev="/dev/sdd"/>
Aug 17 04:36:38 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:36:38 user nova-compute[72793]:   <serial>1775e847-e7c0-4c7b-bed9-33a61927b33e</serial>
Aug 17 04:36:38 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 04:36:38 user nova-compute[72793]: </disk>
Aug 17 04:36:38 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:36:38 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully detached device vdc from instance f265523f-b190-417b-a14f-de23ca190cf9 from the persistent domain config.
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f265523f-b190-417b-a14f-de23ca190cf9 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:36:38 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:36:38 user nova-compute[72793]:   <source dev="/dev/sdd"/>
Aug 17 04:36:38 user nova-compute[72793]:   <target dev="vdc" bus="virtio"/>
Aug 17 04:36:38 user nova-compute[72793]:   <serial>1775e847-e7c0-4c7b-bed9-33a61927b33e</serial>
Aug 17 04:36:38 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 04:36:38 user nova-compute[72793]: </disk>
Aug 17 04:36:38 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692246998.807102, f265523f-b190-417b-a14f-de23ca190cf9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:36:38 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully detached device vdc from instance f265523f-b190-417b-a14f-de23ca190cf9 from the live domain config.
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odBJIXbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:38 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc934d-ec86-4686-ab8f-7a194a55e591]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c418ce9-b6d5-4e59-b34b-f32eaf489313]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:38 user nova-compute[72793]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)
Aug 17 04:36:38 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:38 user nova-compute[72793]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e (non-flash)
Aug 17 04:36:38 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f02f30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e'): ({'sdd'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Removing single pathed devices sdd {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6bbd9c-b44a-4dfe-a618-92e98c500c75]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0c48d-8ec7-4156-aa39-876bb733db92]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Flushing IO for device /dev/sdd {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c722961-617d-4020-8616-43d1dc475f97]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfa9f2-6dd1-4ef4-bf6d-641877a8d491]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] SCSI volumes sdd have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:36:38 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d1616-43e9-4595-9dc7-ede315ef94fd]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e2f7db-e3a4-44e4-8448-0a4bc077a3b0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260]
Aug 17 04:36:39 user nova-compute[72793]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e, portal: 172.16.0.220,3260] successful.
Aug 17 04:36:39 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1775e847-e7c0-4c7b-bed9-33a61927b33e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a468b8-8544-4b71-9586-31efbb801e60]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] <== disconnect_volume: return (280ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG nova.objects.instance [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'flavor' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-62e5944a-86ff-4957-8370-6f0346c5ae6a tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:40 user nova-compute[72793]: INFO nova.compute.manager [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Terminating instance
Aug 17 04:36:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-f913d1f2-5a7f-4d4e-a692-580ba942f59e req-157b5ac8-9e26-44f2-bd45-e75753a06d96 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-vif-unplugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f913d1f2-5a7f-4d4e-a692-580ba942f59e req-157b5ac8-9e26-44f2-bd45-e75753a06d96 service nova] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f913d1f2-5a7f-4d4e-a692-580ba942f59e req-157b5ac8-9e26-44f2-bd45-e75753a06d96 service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f913d1f2-5a7f-4d4e-a692-580ba942f59e req-157b5ac8-9e26-44f2-bd45-e75753a06d96 service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-f913d1f2-5a7f-4d4e-a692-580ba942f59e req-157b5ac8-9e26-44f2-bd45-e75753a06d96 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] No waiting events found dispatching network-vif-unplugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.compute.manager [req-f913d1f2-5a7f-4d4e-a692-580ba942f59e req-157b5ac8-9e26-44f2-bd45-e75753a06d96 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-vif-unplugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Instance destroyed successfully.
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lazy-loading 'resources' on Instance uuid f265523f-b190-417b-a14f-de23ca190cf9 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-623114912',display_name='tempest-AttachVolumeTestJSON-server-623114912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-623114912',id=44,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJx+674o055pY3+JOS2ACpYUzSvWw4iRa4fjHjHnnGoODNPBI0sCVeifPNRIINAapZpAObqC8ls5TD+O/Dqk4sTG8coESQ+KqK5Cy1b6v6woOebyvBk6ngyo/x5GiSCAw==',key_name='tempest-keypair-453903614',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='863a28bd4f24493fa848df117d9edac7',ramdisk_id='',reservation_id='r-s9khzczj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-769655846',owner_user_name='tempest-AttachVolumeTestJSON-769655846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302b737fd798432683e98f2c60b76b71',uuid=f265523f-b190-417b-a14f-de23ca190cf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converting VIF {"id": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "address": "fa:16:3e:7d:5d:7a", "network": {"id": "9901c752-c7ef-4f33-9adc-903b31b425c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924613162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "863a28bd4f24493fa848df117d9edac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59daf1d6-f8", "ovs_interfaceid": "59daf1d6-f8c0-40f9-96d1-63c3aa753196", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG os_vif [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59daf1d6-f8, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:36:41 user nova-compute[72793]: INFO os_vif [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5d:7a,bridge_name='br-int',has_traffic_filtering=True,id=59daf1d6-f8c0-40f9-96d1-63c3aa753196,network=Network(9901c752-c7ef-4f33-9adc-903b31b425c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59daf1d6-f8')
Aug 17 04:36:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Deleting instance files /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9_del
Aug 17 04:36:41 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Deletion of /opt/stack/data/nova/instances/f265523f-b190-417b-a14f-de23ca190cf9_del complete
Aug 17 04:36:41 user nova-compute[72793]: INFO nova.compute.manager [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 04:36:41 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:36:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updating instance_info_cache with network_info: [{"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-d62c1839-9d1a-4537-9e18-5f9f34808c1a" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:36:42 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Took 0.93 seconds to deallocate network for instance.
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.compute.manager [req-388f43a9-92e2-4b12-b501-870a5268b843 req-c8734136-1ae4-43eb-bc46-47734ce8b0f7 service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-vif-deleted-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:36:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:42 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Deleted allocations for instance f265523f-b190-417b-a14f-de23ca190cf9
Aug 17 04:36:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b7b06105-1f32-4821-ab71-a94ead5ace94 tempest-AttachVolumeTestJSON-769655846 tempest-AttachVolumeTestJSON-769655846-project-member] Lock "f265523f-b190-417b-a14f-de23ca190cf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.104s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-88f5fb5a-6d6d-4da8-abd5-af3fa9e6fcef req-7a8f9a43-fbd6-45b2-a202-538986caef1c service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received event network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:36:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-88f5fb5a-6d6d-4da8-abd5-af3fa9e6fcef req-7a8f9a43-fbd6-45b2-a202-538986caef1c service nova] Acquiring lock "f265523f-b190-417b-a14f-de23ca190cf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-88f5fb5a-6d6d-4da8-abd5-af3fa9e6fcef req-7a8f9a43-fbd6-45b2-a202-538986caef1c service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-88f5fb5a-6d6d-4da8-abd5-af3fa9e6fcef req-7a8f9a43-fbd6-45b2-a202-538986caef1c service nova] Lock "f265523f-b190-417b-a14f-de23ca190cf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:43 user nova-compute[72793]: DEBUG nova.compute.manager [req-88f5fb5a-6d6d-4da8-abd5-af3fa9e6fcef req-7a8f9a43-fbd6-45b2-a202-538986caef1c service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] No waiting events found dispatching network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:36:43 user nova-compute[72793]: WARNING nova.compute.manager [req-88f5fb5a-6d6d-4da8-abd5-af3fa9e6fcef req-7a8f9a43-fbd6-45b2-a202-538986caef1c service nova] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Received unexpected event network-vif-plugged-59daf1d6-f8c0-40f9-96d1-63c3aa753196 for instance with vm_state deleted and task_state None.
Aug 17 04:36:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247001.7224338, f265523f-b190-417b-a14f-de23ca190cf9 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:36:56 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: f265523f-b190-417b-a14f-de23ca190cf9] VM Stopped (Lifecycle Event)
Aug 17 04:36:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-3b61ac24-9928-4f44-b1d7-6c545c03cf3f None None] [instance: f265523f-b190-417b-a14f-de23ca190cf9] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:36:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:57 user nova-compute[72793]: INFO nova.compute.manager [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Terminating instance
Aug 17 04:36:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-5cb9b1e8-6aff-4ba0-a309-cc163f6a5e99 req-373adcdb-9988-4f29-ae92-577c0bd927a1 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-vif-unplugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5cb9b1e8-6aff-4ba0-a309-cc163f6a5e99 req-373adcdb-9988-4f29-ae92-577c0bd927a1 service nova] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5cb9b1e8-6aff-4ba0-a309-cc163f6a5e99 req-373adcdb-9988-4f29-ae92-577c0bd927a1 service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-5cb9b1e8-6aff-4ba0-a309-cc163f6a5e99 req-373adcdb-9988-4f29-ae92-577c0bd927a1 service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-5cb9b1e8-6aff-4ba0-a309-cc163f6a5e99 req-373adcdb-9988-4f29-ae92-577c0bd927a1 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] No waiting events found dispatching network-vif-unplugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:36:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-5cb9b1e8-6aff-4ba0-a309-cc163f6a5e99 req-373adcdb-9988-4f29-ae92-577c0bd927a1 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-vif-unplugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:36:57 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Instance destroyed successfully.
Aug 17 04:36:57 user nova-compute[72793]: DEBUG nova.objects.instance [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'resources' on Instance uuid d62c1839-9d1a-4537-9e18-5f9f34808c1a {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:35:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-495689762',display_name='tempest-TestVolumeBootPattern-server-495689762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-495689762',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:35:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-q0r9a03b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:35:28Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=d62c1839-9d1a-4537-9e18-5f9f34808c1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "address": "fa:16:3e:f7:b8:90", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb3c4a4-88", "ovs_interfaceid": "eeb3c4a4-881d-4b76-bbfd-58dad45b38ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_vif [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb3c4a4-88, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:36:58 user nova-compute[72793]: INFO os_vif [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=eeb3c4a4-881d-4b76-bbfd-58dad45b38ac,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb3c4a4-88')
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXDszbkC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:36:58 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee35b80-f962-4233-8d84-0bdeee924939]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9fdcd4-2124-4415-b289-337dfe6dc697]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 (non-flash)
Aug 17 04:36:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acf15870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[908cac83-0aab-4fe5-972a-d6841de63227]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca9d544-2988-455d-942c-f6c6ae073080]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f100a49f-b563-4a7e-80b1-d524474575f3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61888f7d-a0c0-4fb8-bcf2-44bb027f5f68]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7354c6e4-216284f2552f0ff1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7354c6e4', '/dev/disk/by-id/scsi-23231363238346632') {{(pid=84011) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d8f5d-83e8-4064-8519-1a6b6344d7a5]: (4, None) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0f1dc9-972f-4c4e-a327-8daef8287e53]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1761f73b-8384-4d25-9e49-aa01089dc96b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260]
Aug 17 04:36:58 user nova-compute[72793]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3, portal: 172.16.0.220,3260] successful.
Aug 17 04:36:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be9ff51-114a-40c7-ad82-ee9d43b431c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ccc45d-9240-4ca4-b36b-b98dacaadd07]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== disconnect_volume: return (268ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:36:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Deleting instance files /opt/stack/data/nova/instances/d62c1839-9d1a-4537-9e18-5f9f34808c1a_del
Aug 17 04:36:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Deletion of /opt/stack/data/nova/instances/d62c1839-9d1a-4537-9e18-5f9f34808c1a_del complete
Aug 17 04:36:58 user nova-compute[72793]: INFO nova.compute.manager [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 04:36:58 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:36:58 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:36:58 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Took 0.54 seconds to deallocate network for instance.
Aug 17 04:36:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] Acquiring lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] No waiting events found dispatching network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:36:59 user nova-compute[72793]: WARNING nova.compute.manager [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received unexpected event network-vif-plugged-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac for instance with vm_state active and task_state deleting.
Aug 17 04:36:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-eee88983-8d35-4808-8a75-3a29360ac1db req-e3ac99d6-0256-46b2-8e75-ebedb57723c3 service nova] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Received event network-vif-deleted-eeb3c4a4-881d-4b76-bbfd-58dad45b38ac {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:36:59 user nova-compute[72793]: INFO nova.compute.manager [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Took 0.77 seconds to detach 1 volumes for instance.
Aug 17 04:36:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Deleting volume: 3be9ff51-114a-40c7-ad82-ee9d43b431c3 {{(pid=72793) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:36:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:36:59 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Deleted allocations for instance d62c1839-9d1a-4537-9e18-5f9f34808c1a
Aug 17 04:37:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-88bbc614-6d86-4e73-a0a1-327d5d0654a1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d62c1839-9d1a-4537-9e18-5f9f34808c1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:37:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:12 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247017.9858418, d62c1839-9d1a-4537-9e18-5f9f34808c1a => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:37:12 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] VM Stopped (Lifecycle Event)
Aug 17 04:37:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-4fd08a7c-d0cd-4d31-9fcb-2dab876e19dd None None] [instance: d62c1839-9d1a-4537-9e18-5f9f34808c1a] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:37:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:37:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:37:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:37:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:37:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8881MB free_disk=25.354995727539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:37:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:37:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:37:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:37:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:37:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:37:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:37:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:38:13 user nova-compute[72793]: INFO nova.compute.claims [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Claim successful on node user
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:38:13 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:38:13 user nova-compute[72793]: INFO nova.virt.block_device [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Booting with volume b9e478e5-ae8c-438d-990f-ea351dc09a01 at /dev/vda
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.policy [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ac4e1570914524a592a7a67453bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d3627ce05643749885c08563fbe747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG os_brick.utils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa57c4c-e879-4639-b240-fc4913a410d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad5fcc-3b01-4965-90b0-0e4696a65197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[10898f39-b64e-4d45-9340-7882bdba12a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ca3f7-17eb-418f-bf4d-4133c84725ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:38:13 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:38:13 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[65355321-30a8-4331-84d8-cf75cdf0c3a6]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG os_brick.utils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:38:13 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating existing volume attachment record: 0dfb62d4-e5eb-426b-a6ff-c27a846a77b6 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:38:14 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Successfully created port: f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Successfully updated port: f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-changed-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.compute.manager [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Refreshing instance network info cache due to event network-changed-f88b95e7-ed1a-439d-922c-cf029de24af5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Instance network_info: |[{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Refreshing network info cache for port f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updated VIF entry in instance network info cache for port f88b95e7-ed1a-439d-922c-cf029de24af5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG nova.network.neutron [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:38:15 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-83822d43-3313-4c67-8765-0df52df00012 req-a67dc4c5-3062-4422-b7e5-b113c77c5a97 service nova] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:38:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:38:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:38:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:38:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:38:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:38:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Creating image(s)
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Ensure instance console log exists: /opt/stack/data/nova/instances/15c90a37-9b63-4007-ae86-6a04d83b5093/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Start _get_guest_xml network_info=[{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkSzIXTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '15c90a37-9b63-4007-ae86-6a04d83b5093', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9e478e5-ae8c-438d-990f-ea351dc09a01', 'serial': 'b9e478e5-ae8c-438d-990f-ea351dc09a01'}, 'guest_format': None, 'attachment_id': '0dfb62d4-e5eb-426b-a6ff-c27a846a77b6', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:38:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:38:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkSzIXTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:38:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:38:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:38:24 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e98c6-72ed-4570-8001-ce0de448a624]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:38:24 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[15384e78-8b87-434e-90c0-45756efa6062]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01] added
Aug 17 04:38:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52973ef-be33-44f8-884d-2ab11b703d05]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[426aca15-0ba1-4346-a8a9-e617a41459b8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkSzIXTi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkSzIXTi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1241ac-10e8-43ad-a1fc-3d5ec342ec03]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OkSzIXTi'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d59436e-aa0c-4295-9e02-0afddd8092e6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[be128e1f-6bde-49d5-8301-e2202dac86d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:38:24 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:38:24 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:38:24 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:38:24 user nova-compute[72793]: 
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ab5bf2-3d00-40b8-929b-203928b0a9e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260]
Aug 17 04:38:24 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260] successful.
Aug 17 04:38:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dc471d-ad57-4b29-9f40-0b4f3863b79a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffef96e-29ca-427b-8714-fa6decd36444]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:38:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:38:24 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717159f-4f13-4305-8027-7e1c6befef0b]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:38:24 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkSzIXTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23065393030353332', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065393030353332', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-396850165',display_name='tempest-TestVolumeBootPattern-volume-backed-server-396850165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-396850165',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIJjTe3lJabgYto1W4g3TitctKXFDIuHjpVdObouT0MOZfMphf5GG1JZVPk4lQLyhu2R7D/Ta7JgZntd231/w6wMswwPgQbi5ZxXKgYYAe9LcviRKpYaNOCWMe51UgNrQ==',key_name='tempest-keypair-759394887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-qofs0tu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=15c90a37-9b63-4007-ae86-6a04d83b5093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'pci_devices' on Instance uuid 15c90a37-9b63-4007-ae86-6a04d83b5093 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:38:25 user nova-compute[72793]:   <uuid>15c90a37-9b63-4007-ae86-6a04d83b5093</uuid>
Aug 17 04:38:25 user nova-compute[72793]:   <name>instance-0000002e</name>
Aug 17 04:38:25 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:38:25 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:38:25 user nova-compute[72793]:   <metadata>
Aug 17 04:38:25 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:38:25 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:38:25 user nova-compute[72793]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-396850165</nova:name>
Aug 17 04:38:25 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:38:24</nova:creationTime>
Aug 17 04:38:25 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:38:25 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:38:25 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:38:25 user nova-compute[72793]:       <nova:owner>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:user uuid="a0ac4e1570914524a592a7a67453bcc3">tempest-TestVolumeBootPattern-2127448763-project-member</nova:user>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:project uuid="f6d3627ce05643749885c08563fbe747">tempest-TestVolumeBootPattern-2127448763</nova:project>
Aug 17 04:38:25 user nova-compute[72793]:       </nova:owner>
Aug 17 04:38:25 user nova-compute[72793]:       <nova:ports>
Aug 17 04:38:25 user nova-compute[72793]:         <nova:port uuid="f88b95e7-ed1a-439d-922c-cf029de24af5">
Aug 17 04:38:25 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 04:38:25 user nova-compute[72793]:         </nova:port>
Aug 17 04:38:25 user nova-compute[72793]:       </nova:ports>
Aug 17 04:38:25 user nova-compute[72793]:     </nova:instance>
Aug 17 04:38:25 user nova-compute[72793]:   </metadata>
Aug 17 04:38:25 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:38:25 user nova-compute[72793]:     <system>
Aug 17 04:38:25 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:38:25 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:38:25 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:38:25 user nova-compute[72793]:       <entry name="serial">15c90a37-9b63-4007-ae86-6a04d83b5093</entry>
Aug 17 04:38:25 user nova-compute[72793]:       <entry name="uuid">15c90a37-9b63-4007-ae86-6a04d83b5093</entry>
Aug 17 04:38:25 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:38:25 user nova-compute[72793]:     </system>
Aug 17 04:38:25 user nova-compute[72793]:   </sysinfo>
Aug 17 04:38:25 user nova-compute[72793]:   <os>
Aug 17 04:38:25 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:38:25 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:38:25 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:38:25 user nova-compute[72793]:   </os>
Aug 17 04:38:25 user nova-compute[72793]:   <features>
Aug 17 04:38:25 user nova-compute[72793]:     <acpi/>
Aug 17 04:38:25 user nova-compute[72793]:     <apic/>
Aug 17 04:38:25 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:38:25 user nova-compute[72793]:   </features>
Aug 17 04:38:25 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:38:25 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:38:25 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:38:25 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:38:25 user nova-compute[72793]:   </clock>
Aug 17 04:38:25 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:38:25 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:38:25 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:38:25 user nova-compute[72793]:   </cpu>
Aug 17 04:38:25 user nova-compute[72793]:   <devices>
Aug 17 04:38:25 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:38:25 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:38:25 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:38:25 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:38:25 user nova-compute[72793]:       <serial>b9e478e5-ae8c-438d-990f-ea351dc09a01</serial>
Aug 17 04:38:25 user nova-compute[72793]:     </disk>
Aug 17 04:38:25 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:38:25 user nova-compute[72793]:       <mac address="fa:16:3e:65:13:fa"/>
Aug 17 04:38:25 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:38:25 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:38:25 user nova-compute[72793]:       <target dev="tapf88b95e7-ed"/>
Aug 17 04:38:25 user nova-compute[72793]:     </interface>
Aug 17 04:38:25 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:38:25 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/15c90a37-9b63-4007-ae86-6a04d83b5093/console.log" append="off"/>
Aug 17 04:38:25 user nova-compute[72793]:     </serial>
Aug 17 04:38:25 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:38:25 user nova-compute[72793]:     <video>
Aug 17 04:38:25 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:38:25 user nova-compute[72793]:     </video>
Aug 17 04:38:25 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:38:25 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:38:25 user nova-compute[72793]:     </rng>
Aug 17 04:38:25 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:38:25 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:38:25 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:38:25 user nova-compute[72793]:     </memballoon>
Aug 17 04:38:25 user nova-compute[72793]:   </devices>
Aug 17 04:38:25 user nova-compute[72793]: </domain>
Aug 17 04:38:25 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-396850165',display_name='tempest-TestVolumeBootPattern-volume-backed-server-396850165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-396850165',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIJjTe3lJabgYto1W4g3TitctKXFDIuHjpVdObouT0MOZfMphf5GG1JZVPk4lQLyhu2R7D/Ta7JgZntd231/w6wMswwPgQbi5ZxXKgYYAe9LcviRKpYaNOCWMe51UgNrQ==',key_name='tempest-keypair-759394887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-qofs0tu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=15c90a37-9b63-4007-ae86-6a04d83b5093,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG os_vif [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf88b95e7-ed, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf88b95e7-ed, col_values=(('external_ids', {'iface-id': 'f88b95e7-ed1a-439d-922c-cf029de24af5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:13:fa', 'vm-uuid': '15c90a37-9b63-4007-ae86-6a04d83b5093'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:25 user nova-compute[72793]: INFO os_vif [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed')
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:38:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No VIF found with MAC fa:16:3e:65:13:fa, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-3ab7155c-c760-428c-92dd-bf4a8ca6c7b0 req-8ea37a31-69a8-4842-9e49-5bf08f7b651f service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3ab7155c-c760-428c-92dd-bf4a8ca6c7b0 req-8ea37a31-69a8-4842-9e49-5bf08f7b651f service nova] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3ab7155c-c760-428c-92dd-bf4a8ca6c7b0 req-8ea37a31-69a8-4842-9e49-5bf08f7b651f service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-3ab7155c-c760-428c-92dd-bf4a8ca6c7b0 req-8ea37a31-69a8-4842-9e49-5bf08f7b651f service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:26 user nova-compute[72793]: DEBUG nova.compute.manager [req-3ab7155c-c760-428c-92dd-bf4a8ca6c7b0 req-8ea37a31-69a8-4842-9e49-5bf08f7b651f service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] No waiting events found dispatching network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:38:26 user nova-compute[72793]: WARNING nova.compute.manager [req-3ab7155c-c760-428c-92dd-bf4a8ca6c7b0 req-8ea37a31-69a8-4842-9e49-5bf08f7b651f service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received unexpected event network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 for instance with vm_state building and task_state spawning.
Aug 17 04:38:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247108.8732157, 15c90a37-9b63-4007-ae86-6a04d83b5093 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:38:28 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] VM Resumed (Lifecycle Event)
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:38:28 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Instance spawned successfully.
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:38:28 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247108.8742542, 15c90a37-9b63-4007-ae86-6a04d83b5093 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:38:28 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] VM Started (Lifecycle Event)
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:38:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:38:28 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:38:29 user nova-compute[72793]: INFO nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Took 4.93 seconds to spawn the instance on the hypervisor.
Aug 17 04:38:29 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:38:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-926200f6-e129-4bc6-bc71-4a789e03c119 req-1d187e3a-cfcb-4f8b-9b7e-0b01fd67faf8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:38:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-926200f6-e129-4bc6-bc71-4a789e03c119 req-1d187e3a-cfcb-4f8b-9b7e-0b01fd67faf8 service nova] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-926200f6-e129-4bc6-bc71-4a789e03c119 req-1d187e3a-cfcb-4f8b-9b7e-0b01fd67faf8 service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-926200f6-e129-4bc6-bc71-4a789e03c119 req-1d187e3a-cfcb-4f8b-9b7e-0b01fd67faf8 service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:29 user nova-compute[72793]: DEBUG nova.compute.manager [req-926200f6-e129-4bc6-bc71-4a789e03c119 req-1d187e3a-cfcb-4f8b-9b7e-0b01fd67faf8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] No waiting events found dispatching network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:38:29 user nova-compute[72793]: WARNING nova.compute.manager [req-926200f6-e129-4bc6-bc71-4a789e03c119 req-1d187e3a-cfcb-4f8b-9b7e-0b01fd67faf8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received unexpected event network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 for instance with vm_state building and task_state spawning.
Aug 17 04:38:29 user nova-compute[72793]: INFO nova.compute.manager [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Took 16.16 seconds to build instance.
Aug 17 04:38:29 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a1b5af48-70f4-4383-babb-a60e4b872690 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.252s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:32 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:38:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:38:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.343547821044922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 15c90a37-9b63-4007-ae86-6a04d83b5093 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:38:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:38:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 15c90a37-9b63-4007-ae86-6a04d83b5093 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:43 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:38:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:38:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:38:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:38:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:39:04 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:39:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:39:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:39:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:39:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:39:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:39:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:39:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:39:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:39:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.341766357421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 15c90a37-9b63-4007-ae86-6a04d83b5093 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:39:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:39:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:36 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:40 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:39:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:39:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 15c90a37-9b63-4007-ae86-6a04d83b5093 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:39:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:39:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:39:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:39:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:40:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:40:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:40:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-changed-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG nova.compute.manager [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Refreshing instance network info cache due to event network-changed-f88b95e7-ed1a-439d-922c-cf029de24af5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Refreshing network info cache for port f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updated VIF entry in instance network info cache for port f88b95e7-ed1a-439d-922c-cf029de24af5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG nova.network.neutron [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:40:04 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f7409dd0-0f0a-405b-b181-d74c35f19cb0 req-c3a3b510-70cf-44f1-9c93-d8418f5b9de8 service nova] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:40:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:40:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:40:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:40:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:10 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:15 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:40:16 user nova-compute[72793]: INFO nova.compute.claims [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Claim successful on node user
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:40:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.network.neutron [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:40:16 user nova-compute[72793]: INFO nova.virt.block_device [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Booting with volume snapshot 77b57d50-c9ba-4735-89a0-9cd25f585ef1 at /dev/vda
Aug 17 04:40:16 user nova-compute[72793]: DEBUG nova.policy [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ac4e1570914524a592a7a67453bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d3627ce05643749885c08563fbe747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:40:17 user nova-compute[72793]: DEBUG nova.network.neutron [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Successfully created port: 8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Successfully updated port: 8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquired lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-changed-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.compute.manager [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Refreshing instance network info cache due to event network-changed-8c9649ec-24fe-442e-8486-e2ad80583cf9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] Acquiring lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.network.neutron [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updating instance_info_cache with network_info: [{"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Releasing lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Instance network_info: |[{"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] Acquired lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:40:19 user nova-compute[72793]: DEBUG nova.network.neutron [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Refreshing network info cache for port 8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG nova.network.neutron [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updated VIF entry in instance network info cache for port 8c9649ec-24fe-442e-8486-e2ad80583cf9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG nova.network.neutron [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updating instance_info_cache with network_info: [{"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-429c260b-ace9-4594-96ec-e4b45d0cc52c req-3306e9d8-3904-405c-9457-c18f85e960ec service nova] Releasing lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:40:20 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG os_brick.utils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e6d0e6-a973-4f76-ad00-a29b7e081603]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[723cb84f-191a-4a82-bb1e-79d64ddb4611]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e9be0b-0c7c-4c35-9d19-f650f4595c80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1579fe-f363-4068-a21d-d245cd83cd7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:40:22 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:40:22 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fb0199-2b75-4429-a4d2-fe6ed313693b]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG os_brick.utils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:40:22 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updating existing volume attachment record: d3a10869-bf67-4c55-81c1-07f62ad70c3f {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:40:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:30 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:40:33 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Creating image(s)
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Ensure instance console log exists: /opt/stack/data/nova/instances/d29fd0c0-0319-4b01-b836-46744ebbefe7/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Start _get_guest_xml network_info=[{"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T04:40:06Z,direct_url=<?>,disk_format='qcow2',id=4d63d176-8a69-4271-b7ea-089d02d78276,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-414719949',owner='f6d3627ce05643749885c08563fbe747',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T04:40:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpJTevtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd29fd0c0-0319-4b01-b836-46744ebbefe7', 'attached_at': '', 'detached_at': '', 'volume_id': '6b503b22-e4ed-41e7-a9c0-c751df3a67bf', 'serial': '6b503b22-e4ed-41e7-a9c0-c751df3a67bf'}, 'guest_format': None, 'attachment_id': 'd3a10869-bf67-4c55-81c1-07f62ad70c3f', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:40:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:40:33 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T04:40:06Z,direct_url=<?>,disk_format='qcow2',id=4d63d176-8a69-4271-b7ea-089d02d78276,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-414719949',owner='f6d3627ce05643749885c08563fbe747',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T04:40:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpJTevtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:40:33 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:40:33 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:40:33 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[12375f8d-e1b3-49c7-a31a-fd68e1a43010]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:40:33 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6f9a2-b2ec-4d8a-8e9c-7e65d3b7bc33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf] added
Aug 17 04:40:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc483d9-1cdc-4bff-ba1f-ecc03597eaad]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cdfc29-84c4-4698-89d8-f5c6d2cfe7af]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpJTevtn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpJTevtn" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be640b7-f742-46f7-8c3a-d75d9ad85bec]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kpJTevtn'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed39ff1-af46-4099-b7e3-1a9319ceadd2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00fb6b7-2a11-473a-9c32-5be4a8728476]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:40:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:40:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7800c1d6-8d17-44f8-a7f3-755164319c5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260]
Aug 17 04:40:33 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260] successful.
Aug 17 04:40:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb51a5-07db-494a-9281-8598d23536ff]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a3ed53-7ef2-4c5d-9a0d-1170708db1df]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:40:33 user nova-compute[72793]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf (non-flash)
Aug 17 04:40:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:40:33 user nova-compute[72793]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf (non-flash)
Aug 17 04:40:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9260058-fc48-4e4b-afc0-7c0188dabb3d]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpJTevtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:40:33 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:40:34 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:40:34 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.330997467041016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 15c90a37-9b63-4007-ae86-6a04d83b5093 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d29fd0c0-0319-4b01-b836-46744ebbefe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26632303263363162', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632303263363162', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-850268529',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-850268529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-850268529',id=47,image_ref='4d63d176-8a69-4271-b7ea-089d02d78276',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnuseBOZncM7zP7fEbwWXjnrCOt/zOAq25EW8Z2j/U36tNSkroATmagYd5hn1TD82Ih2tLs+k0bzEGxYWjxWWQRXXWYEndfbU4gyhNxLFeFCceROLAe1r9ZIGamWxjXpQ==',key_name='tempest-keypair-193613589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-4bq2mws7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2127448763',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=d29fd0c0-0319-4b01-b836-46744ebbefe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.objects.instance [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'pci_devices' on Instance uuid d29fd0c0-0319-4b01-b836-46744ebbefe7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:40:34 user nova-compute[72793]:   <uuid>d29fd0c0-0319-4b01-b836-46744ebbefe7</uuid>
Aug 17 04:40:34 user nova-compute[72793]:   <name>instance-0000002f</name>
Aug 17 04:40:34 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:40:34 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:40:34 user nova-compute[72793]:   <metadata>
Aug 17 04:40:34 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:40:34 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:40:34 user nova-compute[72793]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-850268529</nova:name>
Aug 17 04:40:34 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:40:33</nova:creationTime>
Aug 17 04:40:34 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:40:34 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:40:34 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:40:34 user nova-compute[72793]:       <nova:owner>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:user uuid="a0ac4e1570914524a592a7a67453bcc3">tempest-TestVolumeBootPattern-2127448763-project-member</nova:user>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:project uuid="f6d3627ce05643749885c08563fbe747">tempest-TestVolumeBootPattern-2127448763</nova:project>
Aug 17 04:40:34 user nova-compute[72793]:       </nova:owner>
Aug 17 04:40:34 user nova-compute[72793]:       <nova:root type="image" uuid="4d63d176-8a69-4271-b7ea-089d02d78276"/>
Aug 17 04:40:34 user nova-compute[72793]:       <nova:ports>
Aug 17 04:40:34 user nova-compute[72793]:         <nova:port uuid="8c9649ec-24fe-442e-8486-e2ad80583cf9">
Aug 17 04:40:34 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 04:40:34 user nova-compute[72793]:         </nova:port>
Aug 17 04:40:34 user nova-compute[72793]:       </nova:ports>
Aug 17 04:40:34 user nova-compute[72793]:     </nova:instance>
Aug 17 04:40:34 user nova-compute[72793]:   </metadata>
Aug 17 04:40:34 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:40:34 user nova-compute[72793]:     <system>
Aug 17 04:40:34 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:40:34 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:40:34 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:40:34 user nova-compute[72793]:       <entry name="serial">d29fd0c0-0319-4b01-b836-46744ebbefe7</entry>
Aug 17 04:40:34 user nova-compute[72793]:       <entry name="uuid">d29fd0c0-0319-4b01-b836-46744ebbefe7</entry>
Aug 17 04:40:34 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:40:34 user nova-compute[72793]:     </system>
Aug 17 04:40:34 user nova-compute[72793]:   </sysinfo>
Aug 17 04:40:34 user nova-compute[72793]:   <os>
Aug 17 04:40:34 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:40:34 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:40:34 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:40:34 user nova-compute[72793]:   </os>
Aug 17 04:40:34 user nova-compute[72793]:   <features>
Aug 17 04:40:34 user nova-compute[72793]:     <acpi/>
Aug 17 04:40:34 user nova-compute[72793]:     <apic/>
Aug 17 04:40:34 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:40:34 user nova-compute[72793]:   </features>
Aug 17 04:40:34 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:40:34 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:40:34 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:40:34 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:40:34 user nova-compute[72793]:   </clock>
Aug 17 04:40:34 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:40:34 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:40:34 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:40:34 user nova-compute[72793]:   </cpu>
Aug 17 04:40:34 user nova-compute[72793]:   <devices>
Aug 17 04:40:34 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:40:34 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:40:34 user nova-compute[72793]:       <source dev="/dev/sdc"/>
Aug 17 04:40:34 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:40:34 user nova-compute[72793]:       <serial>6b503b22-e4ed-41e7-a9c0-c751df3a67bf</serial>
Aug 17 04:40:34 user nova-compute[72793]:     </disk>
Aug 17 04:40:34 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:40:34 user nova-compute[72793]:       <mac address="fa:16:3e:07:f9:0a"/>
Aug 17 04:40:34 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:40:34 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:40:34 user nova-compute[72793]:       <target dev="tap8c9649ec-24"/>
Aug 17 04:40:34 user nova-compute[72793]:     </interface>
Aug 17 04:40:34 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:40:34 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/d29fd0c0-0319-4b01-b836-46744ebbefe7/console.log" append="off"/>
Aug 17 04:40:34 user nova-compute[72793]:     </serial>
Aug 17 04:40:34 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:40:34 user nova-compute[72793]:     <video>
Aug 17 04:40:34 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:40:34 user nova-compute[72793]:     </video>
Aug 17 04:40:34 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:40:34 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:40:34 user nova-compute[72793]:     </rng>
Aug 17 04:40:34 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:40:34 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:40:34 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:40:34 user nova-compute[72793]:     </memballoon>
Aug 17 04:40:34 user nova-compute[72793]:   </devices>
Aug 17 04:40:34 user nova-compute[72793]: </domain>
Aug 17 04:40:34 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-850268529',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-850268529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-850268529',id=47,image_ref='4d63d176-8a69-4271-b7ea-089d02d78276',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnuseBOZncM7zP7fEbwWXjnrCOt/zOAq25EW8Z2j/U36tNSkroATmagYd5hn1TD82Ih2tLs+k0bzEGxYWjxWWQRXXWYEndfbU4gyhNxLFeFCceROLAe1r9ZIGamWxjXpQ==',key_name='tempest-keypair-193613589',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-4bq2mws7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2127448763',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=d29fd0c0-0319-4b01-b836-46744ebbefe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG os_vif [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c9649ec-24, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c9649ec-24, col_values=(('external_ids', {'iface-id': '8c9649ec-24fe-442e-8486-e2ad80583cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:f9:0a', 'vm-uuid': 'd29fd0c0-0319-4b01-b836-46744ebbefe7'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:40:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:35 user nova-compute[72793]: INFO os_vif [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24')
Aug 17 04:40:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:40:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No VIF found with MAC fa:16:3e:07:f9:0a, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:40:35 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-f93378dc-d258-4ada-af52-f709c86cd41a req-f7354b9b-00e3-4dec-96a1-4c4f229a54f8 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f93378dc-d258-4ada-af52-f709c86cd41a req-f7354b9b-00e3-4dec-96a1-4c4f229a54f8 service nova] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f93378dc-d258-4ada-af52-f709c86cd41a req-f7354b9b-00e3-4dec-96a1-4c4f229a54f8 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f93378dc-d258-4ada-af52-f709c86cd41a req-f7354b9b-00e3-4dec-96a1-4c4f229a54f8 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:36 user nova-compute[72793]: DEBUG nova.compute.manager [req-f93378dc-d258-4ada-af52-f709c86cd41a req-f7354b9b-00e3-4dec-96a1-4c4f229a54f8 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] No waiting events found dispatching network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:40:36 user nova-compute[72793]: WARNING nova.compute.manager [req-f93378dc-d258-4ada-af52-f709c86cd41a req-f7354b9b-00e3-4dec-96a1-4c4f229a54f8 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received unexpected event network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 for instance with vm_state building and task_state spawning.
Aug 17 04:40:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247238.3484435, d29fd0c0-0319-4b01-b836-46744ebbefe7 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] VM Resumed (Lifecycle Event)
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Instance spawned successfully.
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247238.3499029, d29fd0c0-0319-4b01-b836-46744ebbefe7 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] VM Started (Lifecycle Event)
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:40:38 user nova-compute[72793]: INFO nova.compute.manager [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Took 22.31 seconds to build instance.
Aug 17 04:40:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-dc9e5729-7ac7-47c4-ad26-2729dfde9197 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.414s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-bbeec57d-cd80-46f6-9d91-c285eadbd6de req-f117bc42-8ad1-452c-b5f6-e57e7c9b2664 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bbeec57d-cd80-46f6-9d91-c285eadbd6de req-f117bc42-8ad1-452c-b5f6-e57e7c9b2664 service nova] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bbeec57d-cd80-46f6-9d91-c285eadbd6de req-f117bc42-8ad1-452c-b5f6-e57e7c9b2664 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-bbeec57d-cd80-46f6-9d91-c285eadbd6de req-f117bc42-8ad1-452c-b5f6-e57e7c9b2664 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:38 user nova-compute[72793]: DEBUG nova.compute.manager [req-bbeec57d-cd80-46f6-9d91-c285eadbd6de req-f117bc42-8ad1-452c-b5f6-e57e7c9b2664 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] No waiting events found dispatching network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:40:38 user nova-compute[72793]: WARNING nova.compute.manager [req-bbeec57d-cd80-46f6-9d91-c285eadbd6de req-f117bc42-8ad1-452c-b5f6-e57e7c9b2664 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received unexpected event network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 for instance with vm_state active and task_state None.
Aug 17 04:40:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:41 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:40:41 user nova-compute[72793]: INFO nova.compute.claims [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Claim successful on node user
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.network.neutron [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:40:42 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.policy [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06771933e20420492746df80977e210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3241396d2e934d7cb1bcb8d16e00e4e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:40:42 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Creating image(s)
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "/opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "/opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "/opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk 1073741824" returned: 0 in 0.049s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Cannot resize image /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG nova.objects.instance [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lazy-loading 'migration_context' on Instance uuid 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Ensure instance console log exists: /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:43 user nova-compute[72793]: DEBUG nova.network.neutron [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Successfully created port: 239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Successfully updated port: 239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquired lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-changed-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.compute.manager [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Refreshing instance network info cache due to event network-changed-239edbf2-ab33-45dd-9d23-713abbe222e5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] Acquiring lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.neutron [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating instance_info_cache with network_info: [{"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Releasing lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Instance network_info: |[{"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] Acquired lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.neutron [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Refreshing network info cache for port 239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Start _get_guest_xml network_info=[{"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:40:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:40:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3749486',id=48,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWpYNioPly/iKvseu8FhZ+NwyGtTu2q0hfP6gZlULjCa5YV8NbnacTfMyA86jFk5/cX/q2oxpz9i8W/6mOn4pwbMhP+OcEjMXiRbrXJGcCBNZe0y4185vODDmZwnYfeg==',key_name='tempest-keypair-623108985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3241396d2e934d7cb1bcb8d16e00e4e6',ramdisk_id='',reservation_id='r-6wtbucyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-776435379',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06771933e20420492746df80977e210',uuid=4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Converting VIF {"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.objects.instance [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lazy-loading 'pci_devices' on Instance uuid 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:40:44 user nova-compute[72793]:   <uuid>4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd</uuid>
Aug 17 04:40:44 user nova-compute[72793]:   <name>instance-00000030</name>
Aug 17 04:40:44 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:40:44 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:40:44 user nova-compute[72793]:   <metadata>
Aug 17 04:40:44 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:40:44 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:40:44 user nova-compute[72793]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617</nova:name>
Aug 17 04:40:44 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:40:44</nova:creationTime>
Aug 17 04:40:44 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:40:44 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:40:44 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:40:44 user nova-compute[72793]:       <nova:owner>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:user uuid="f06771933e20420492746df80977e210">tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member</nova:user>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:project uuid="3241396d2e934d7cb1bcb8d16e00e4e6">tempest-TestServerVolumeAttachScenarioOldVersion-776435379</nova:project>
Aug 17 04:40:44 user nova-compute[72793]:       </nova:owner>
Aug 17 04:40:44 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:40:44 user nova-compute[72793]:       <nova:ports>
Aug 17 04:40:44 user nova-compute[72793]:         <nova:port uuid="239edbf2-ab33-45dd-9d23-713abbe222e5">
Aug 17 04:40:44 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:40:44 user nova-compute[72793]:         </nova:port>
Aug 17 04:40:44 user nova-compute[72793]:       </nova:ports>
Aug 17 04:40:44 user nova-compute[72793]:     </nova:instance>
Aug 17 04:40:44 user nova-compute[72793]:   </metadata>
Aug 17 04:40:44 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:40:44 user nova-compute[72793]:     <system>
Aug 17 04:40:44 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:40:44 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:40:44 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:40:44 user nova-compute[72793]:       <entry name="serial">4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd</entry>
Aug 17 04:40:44 user nova-compute[72793]:       <entry name="uuid">4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd</entry>
Aug 17 04:40:44 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:40:44 user nova-compute[72793]:     </system>
Aug 17 04:40:44 user nova-compute[72793]:   </sysinfo>
Aug 17 04:40:44 user nova-compute[72793]:   <os>
Aug 17 04:40:44 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:40:44 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:40:44 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:40:44 user nova-compute[72793]:   </os>
Aug 17 04:40:44 user nova-compute[72793]:   <features>
Aug 17 04:40:44 user nova-compute[72793]:     <acpi/>
Aug 17 04:40:44 user nova-compute[72793]:     <apic/>
Aug 17 04:40:44 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:40:44 user nova-compute[72793]:   </features>
Aug 17 04:40:44 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:40:44 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:40:44 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:40:44 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:40:44 user nova-compute[72793]:   </clock>
Aug 17 04:40:44 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:40:44 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:40:44 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:40:44 user nova-compute[72793]:   </cpu>
Aug 17 04:40:44 user nova-compute[72793]:   <devices>
Aug 17 04:40:44 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:40:44 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:40:44 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk"/>
Aug 17 04:40:44 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:40:44 user nova-compute[72793]:     </disk>
Aug 17 04:40:44 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:40:44 user nova-compute[72793]:       <mac address="fa:16:3e:98:01:86"/>
Aug 17 04:40:44 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:40:44 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:40:44 user nova-compute[72793]:       <target dev="tap239edbf2-ab"/>
Aug 17 04:40:44 user nova-compute[72793]:     </interface>
Aug 17 04:40:44 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:40:44 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/console.log" append="off"/>
Aug 17 04:40:44 user nova-compute[72793]:     </serial>
Aug 17 04:40:44 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:40:44 user nova-compute[72793]:     <video>
Aug 17 04:40:44 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:40:44 user nova-compute[72793]:     </video>
Aug 17 04:40:44 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:40:44 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:40:44 user nova-compute[72793]:     </rng>
Aug 17 04:40:44 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:40:44 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:40:44 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:40:44 user nova-compute[72793]:     </memballoon>
Aug 17 04:40:44 user nova-compute[72793]:   </devices>
Aug 17 04:40:44 user nova-compute[72793]: </domain>
Aug 17 04:40:44 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3749486',id=48,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWpYNioPly/iKvseu8FhZ+NwyGtTu2q0hfP6gZlULjCa5YV8NbnacTfMyA86jFk5/cX/q2oxpz9i8W/6mOn4pwbMhP+OcEjMXiRbrXJGcCBNZe0y4185vODDmZwnYfeg==',key_name='tempest-keypair-623108985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3241396d2e934d7cb1bcb8d16e00e4e6',ramdisk_id='',reservation_id='r-6wtbucyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-776435379',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06771933e20420492746df80977e210',uuid=4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Converting VIF {"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG os_vif [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap239edbf2-ab, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap239edbf2-ab, col_values=(('external_ids', {'iface-id': '239edbf2-ab33-45dd-9d23-713abbe222e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:01:86', 'vm-uuid': '4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:44 user nova-compute[72793]: INFO os_vif [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab')
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] No VIF found with MAC fa:16:3e:98:01:86, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:44 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:40:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updated VIF entry in instance network info cache for port 239edbf2-ab33-45dd-9d23-713abbe222e5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:40:45 user nova-compute[72793]: DEBUG nova.network.neutron [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating instance_info_cache with network_info: [{"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:40:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-88eab1e0-0b60-4265-8385-3386c333ac2e req-f207bedd-819d-4cab-83f3-723da73a1527 service nova] Releasing lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:40:45 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:40:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:40:45 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Skipping network cache update for instance because it is Building. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 15c90a37-9b63-4007-ae86-6a04d83b5093 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e362d10-f8ab-4671-b42c-a03fd2ff5676 req-f7f66f9f-877e-4a83-8724-287ffa064363 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e362d10-f8ab-4671-b42c-a03fd2ff5676 req-f7f66f9f-877e-4a83-8724-287ffa064363 service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e362d10-f8ab-4671-b42c-a03fd2ff5676 req-f7f66f9f-877e-4a83-8724-287ffa064363 service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8e362d10-f8ab-4671-b42c-a03fd2ff5676 req-f7f66f9f-877e-4a83-8724-287ffa064363 service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-8e362d10-f8ab-4671-b42c-a03fd2ff5676 req-f7f66f9f-877e-4a83-8724-287ffa064363 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:40:46 user nova-compute[72793]: WARNING nova.compute.manager [req-8e362d10-f8ab-4671-b42c-a03fd2ff5676 req-f7f66f9f-877e-4a83-8724-287ffa064363 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received unexpected event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with vm_state building and task_state spawning.
Aug 17 04:40:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:47 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:40:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:40:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247248.2833362, 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] VM Resumed (Lifecycle Event)
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Instance spawned successfully.
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247248.2844837, 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] VM Started (Lifecycle Event)
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:40:48 user nova-compute[72793]: INFO nova.compute.manager [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Took 6.59 seconds to build instance.
Aug 17 04:40:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-df5b2a9d-e393-4e0a-8c69-79750a153d0a tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.690s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-e5dad26c-6873-412b-aa85-cff9e9a9042e req-abfb96e9-7fd4-4857-a558-55d108f83c7b service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e5dad26c-6873-412b-aa85-cff9e9a9042e req-abfb96e9-7fd4-4857-a558-55d108f83c7b service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e5dad26c-6873-412b-aa85-cff9e9a9042e req-abfb96e9-7fd4-4857-a558-55d108f83c7b service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e5dad26c-6873-412b-aa85-cff9e9a9042e req-abfb96e9-7fd4-4857-a558-55d108f83c7b service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:40:48 user nova-compute[72793]: DEBUG nova.compute.manager [req-e5dad26c-6873-412b-aa85-cff9e9a9042e req-abfb96e9-7fd4-4857-a558-55d108f83c7b service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:40:48 user nova-compute[72793]: WARNING nova.compute.manager [req-e5dad26c-6873-412b-aa85-cff9e9a9042e req-abfb96e9-7fd4-4857-a558-55d108f83c7b service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received unexpected event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with vm_state active and task_state None.
Aug 17 04:40:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:40:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:41:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:41:34 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:41:35 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:41:35 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:41:35 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=25.300434112548828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:41:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 15c90a37-9b63-4007-ae86-6a04d83b5093 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance d29fd0c0-0319-4b01-b836-46744ebbefe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:41:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:41:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:41:39 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updating instance_info_cache with network_info: [{"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:41:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:41:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:41:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-changed-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG nova.compute.manager [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Refreshing instance network info cache due to event network-changed-8c9649ec-24fe-442e-8486-e2ad80583cf9. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] Acquiring lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] Acquired lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Refreshing network info cache for port 8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updated VIF entry in instance network info cache for port 8c9649ec-24fe-442e-8486-e2ad80583cf9. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:42:07 user nova-compute[72793]: DEBUG nova.network.neutron [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updating instance_info_cache with network_info: [{"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:42:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-529ab67b-0c86-4859-aa0c-6eb946165a0f req-2ded9535-7657-40f5-be25-6e140b286326 service nova] Releasing lock "refresh_cache-d29fd0c0-0319-4b01-b836-46744ebbefe7" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:09 user nova-compute[72793]: INFO nova.compute.manager [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Terminating instance
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-8d5ddd1f-9b0f-450d-a029-21b3eccf88d2 req-42c1dceb-768e-4a6f-94f1-9a01a7abe158 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-vif-unplugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8d5ddd1f-9b0f-450d-a029-21b3eccf88d2 req-42c1dceb-768e-4a6f-94f1-9a01a7abe158 service nova] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8d5ddd1f-9b0f-450d-a029-21b3eccf88d2 req-42c1dceb-768e-4a6f-94f1-9a01a7abe158 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-8d5ddd1f-9b0f-450d-a029-21b3eccf88d2 req-42c1dceb-768e-4a6f-94f1-9a01a7abe158 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-8d5ddd1f-9b0f-450d-a029-21b3eccf88d2 req-42c1dceb-768e-4a6f-94f1-9a01a7abe158 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] No waiting events found dispatching network-vif-unplugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.compute.manager [req-8d5ddd1f-9b0f-450d-a029-21b3eccf88d2 req-42c1dceb-768e-4a6f-94f1-9a01a7abe158 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-vif-unplugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Instance destroyed successfully.
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'resources' on Instance uuid d29fd0c0-0319-4b01-b836-46744ebbefe7 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:40:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-850268529',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-850268529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-850268529',id=47,image_ref='4d63d176-8a69-4271-b7ea-089d02d78276',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnuseBOZncM7zP7fEbwWXjnrCOt/zOAq25EW8Z2j/U36tNSkroATmagYd5hn1TD82Ih2tLs+k0bzEGxYWjxWWQRXXWYEndfbU4gyhNxLFeFCceROLAe1r9ZIGamWxjXpQ==',key_name='tempest-keypair-193613589',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-4bq2mws7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2127448763',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=d29fd0c0-0319-4b01-b836-46744ebbefe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "address": "fa:16:3e:07:f9:0a", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c9649ec-24", "ovs_interfaceid": "8c9649ec-24fe-442e-8486-e2ad80583cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_vif [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c9649ec-24, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:09 user nova-compute[72793]: INFO os_vif [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:f9:0a,bridge_name='br-int',has_traffic_filtering=True,id=8c9649ec-24fe-442e-8486-e2ad80583cf9,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c9649ec-24')
Aug 17 04:42:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpJTevtn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:42:09 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[40294df9-f1bc-4582-a25d-702514bf96ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d95bf3-fdf5-467e-9e04-8d1211934f96]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:09 user nova-compute[72793]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf (non-flash)
Aug 17 04:42:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:09 user nova-compute[72793]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf (non-flash)
Aug 17 04:42:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02bbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:42:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad120e74-4bc9-40d3-868b-6297b9d1a662]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9810ce73-9432-45fe-8068-1712650934b4]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cbfa9f-a762-4acf-842a-a77f25f914dc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6dbd9-3ddc-4f7f-8dd0-1288e5ceb876]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b90ade-bf48-4e6b-aedf-132c08370b25]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c656a828-c363-4962-8de4-488b164693e5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260]
Aug 17 04:42:10 user nova-compute[72793]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf, portal: 172.16.0.220,3260] successful.
Aug 17 04:42:10 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b503b22-e4ed-41e7-a9c0-c751df3a67bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[879cc3da-a0ef-4b23-96c4-836cf7947a3b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== disconnect_volume: return (294ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:42:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Deleting instance files /opt/stack/data/nova/instances/d29fd0c0-0319-4b01-b836-46744ebbefe7_del
Aug 17 04:42:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Deletion of /opt/stack/data/nova/instances/d29fd0c0-0319-4b01-b836-46744ebbefe7_del complete
Aug 17 04:42:10 user nova-compute[72793]: INFO nova.compute.manager [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 17 04:42:10 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:42:10 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:42:11 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Took 1.03 seconds to deallocate network for instance.
Aug 17 04:42:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-c6d575ba-7e4b-4821-9b6f-4a0d5801869c req-f5d73843-dc74-44d5-8a18-1ee21acfb2be service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-vif-deleted-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-6cc245a3-dced-40ad-9d8b-2c6c4e5ea50a req-637a02b7-f402-456d-87d6-30203e8f4673 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received event network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6cc245a3-dced-40ad-9d8b-2c6c4e5ea50a req-637a02b7-f402-456d-87d6-30203e8f4673 service nova] Acquiring lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6cc245a3-dced-40ad-9d8b-2c6c4e5ea50a req-637a02b7-f402-456d-87d6-30203e8f4673 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6cc245a3-dced-40ad-9d8b-2c6c4e5ea50a req-637a02b7-f402-456d-87d6-30203e8f4673 service nova] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:11 user nova-compute[72793]: DEBUG nova.compute.manager [req-6cc245a3-dced-40ad-9d8b-2c6c4e5ea50a req-637a02b7-f402-456d-87d6-30203e8f4673 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] No waiting events found dispatching network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:42:11 user nova-compute[72793]: WARNING nova.compute.manager [req-6cc245a3-dced-40ad-9d8b-2c6c4e5ea50a req-637a02b7-f402-456d-87d6-30203e8f4673 service nova] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Received unexpected event network-vif-plugged-8c9649ec-24fe-442e-8486-e2ad80583cf9 for instance with vm_state active and task_state deleting.
Aug 17 04:42:12 user nova-compute[72793]: INFO nova.compute.manager [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 04:42:12 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Deleting volume: 6b503b22-e4ed-41e7-a9c0-c751df3a67bf {{(pid=72793) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 04:42:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:12 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:42:12 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:42:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:12 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Deleted allocations for instance d29fd0c0-0319-4b01-b836-46744ebbefe7
Aug 17 04:42:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ba52a03e-ba46-4b69-9656-a737977b803a tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "d29fd0c0-0319-4b01-b836-46744ebbefe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:24 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247329.875824, d29fd0c0-0319-4b01-b836-46744ebbefe7 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:42:24 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] VM Stopped (Lifecycle Event)
Aug 17 04:42:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b5781715-42ca-4fb9-a989-dbbbb208c3a8 None None] [instance: d29fd0c0-0319-4b01-b836-46744ebbefe7] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:42:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:42:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:42:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-changed-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:42:32 user nova-compute[72793]: DEBUG nova.compute.manager [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Refreshing instance network info cache due to event network-changed-239edbf2-ab33-45dd-9d23-713abbe222e5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:42:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] Acquiring lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:42:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] Acquired lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:42:32 user nova-compute[72793]: DEBUG nova.network.neutron [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Refreshing network info cache for port 239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:42:33 user nova-compute[72793]: DEBUG nova.network.neutron [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updated VIF entry in instance network info cache for port 239edbf2-ab33-45dd-9d23-713abbe222e5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:42:33 user nova-compute[72793]: DEBUG nova.network.neutron [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating instance_info_cache with network_info: [{"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:42:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-d290bf07-74e0-4da1-ae88-b8f64e25bd34 req-7ee09456-7483-48be-906c-3dd6f6695638 service nova] Releasing lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:42:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:42:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:42:36 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:42:36 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:42:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8636MB free_disk=25.299388885498047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 15c90a37-9b63-4007-ae86-6a04d83b5093 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:42:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:38 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lazy-loading 'flavor' on Instance uuid 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:39 user nova-compute[72793]: INFO nova.compute.manager [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Attaching volume 69fab998-76f4-4ccd-a9be-26da5aab450d to /dev/vdb
Aug 17 04:42:39 user nova-compute[72793]: DEBUG os_brick.utils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c871300-9cbb-4ac2-9888-554ef43989a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52f6ad-441d-4fd6-a078-2d1202dd249b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9537dca5-7a07-4f91-aa74-7096e4d29a2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309bfa4-ec01-41eb-ba2b-3f871bcb0d8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:42:39 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:42:39 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e85d6ee-a2dc-4833-b23e-4c830d273432]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG os_brick.utils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating existing volume attachment record: bf17f12e-6b5f-4a33-a666-598554152a9f {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:42:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:42:47 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 15c90a37-9b63-4007-ae86-6a04d83b5093 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [{"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-15c90a37-9b63-4007-ae86-6a04d83b5093" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:42:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:42:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kujWINzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:42:55 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:42:55 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:42:55 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45accf8-2e26-495c-8a25-f9e347bdde40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:42:55 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b9698-b201-4c28-907f-fb8d49ea3276]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d] added
Aug 17 04:42:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4b0c7f-8635-4819-bfaf-2c0d4874c909]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc205db9-9ba6-4908-b0ec-91f05b917484]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kujWINzC {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kujWINzC" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdec319-3652-48a6-ac29-cc499f845fc6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kujWINzC'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3b88fb-8e6d-4fe9-ba51-ddc13f7bcaf2]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[468084d9-b409-4b0c-bce3-110430aee752]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d34ac6-87e5-4bb3-a514-17f853597dcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260]
Aug 17 04:42:55 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260] successful.
Aug 17 04:42:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae58dcd-4eca-4930-8e6d-5b442e1523d5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3748b712-c02c-4753-a434-3fd41a5bcfe1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:55 user nova-compute[72793]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d (non-flash)
Aug 17 04:42:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:55 user nova-compute[72793]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d (non-flash)
Aug 17 04:42:55 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[627e069a-01be-4cc9-a5d9-98ac95acc609]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:42:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kujWINzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:42:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:42:56 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26436383866636332', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:42:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436383866636332', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:42:56 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lazy-loading 'flavor' on Instance uuid 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:42:56 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:42:56 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:42:56 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:42:56 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:42:56 user nova-compute[72793]:   <serial>69fab998-76f4-4ccd-a9be-26da5aab450d</serial>
Aug 17 04:42:56 user nova-compute[72793]: </disk>
Aug 17 04:42:56 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:42:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:42:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:42:57 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] No VIF found with MAC fa:16:3e:98:01:86, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:42:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7de97f40-8256-47a5-bab2-3b80a1a3cfc4 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.255s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:42:58 user nova-compute[72793]: INFO nova.compute.manager [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Detaching volume 69fab998-76f4-4ccd-a9be-26da5aab450d
Aug 17 04:42:58 user nova-compute[72793]: INFO nova.virt.block_device [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Attempting to driver detach volume 69fab998-76f4-4ccd-a9be-26da5aab450d from mountpoint /dev/vdb
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Attempting to detach device vdb from instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:42:58 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:42:58 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:42:58 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:42:58 user nova-compute[72793]:   <serial>69fab998-76f4-4ccd-a9be-26da5aab450d</serial>
Aug 17 04:42:58 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:42:58 user nova-compute[72793]: </disk>
Aug 17 04:42:58 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:42:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Successfully detached device vdb from instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd from the persistent domain config.
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:42:58 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:42:58 user nova-compute[72793]:   <source dev="/dev/sdc"/>
Aug 17 04:42:58 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:42:58 user nova-compute[72793]:   <serial>69fab998-76f4-4ccd-a9be-26da5aab450d</serial>
Aug 17 04:42:58 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:42:58 user nova-compute[72793]: </disk>
Aug 17 04:42:58 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692247378.8190267, 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:42:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Successfully detached device vdb from instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd from the live domain config.
Aug 17 04:42:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kujWINzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:42:58 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[858149e9-33f3-4691-a3a8-ed57f7b54758]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f62b0-1015-4d3f-b1ca-faf280d86167]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:58 user nova-compute[72793]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d (non-flash)
Aug 17 04:42:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:42:58 user nova-compute[72793]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d (non-flash)
Aug 17 04:42:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f02f2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02a56c5-2eae-44f1-b818-83d3aef8663d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9af529-b644-462a-82ce-b530d6d82997]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e631b-980a-4850-9572-90e4f5e03a0a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:42:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[253567cb-b5b1-440f-8cd7-742ddf6ad7f4]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[789757cd-77f7-4923-a08a-789250f08d77]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03c4fe-424f-4e49-9e32-66e24b59412c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260]
Aug 17 04:42:59 user nova-compute[72793]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d, portal: 172.16.0.220,3260] successful.
Aug 17 04:42:59 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69fab998-76f4-4ccd-a9be-26da5aab450d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b69519-40cd-4059-9445-8852a0c73fb6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] <== disconnect_volume: return (297ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG nova.objects.instance [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lazy-loading 'flavor' on Instance uuid 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-3e9d81dd-8811-4f4e-8d56-7e6c0fc57300 tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.630s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:42:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:05 user nova-compute[72793]: INFO nova.compute.manager [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Terminating instance
Aug 17 04:43:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddc31862-7936-47df-97eb-6fe437708c3d req-b6f37021-1813-455f-8497-2c7916309747 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-vif-unplugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddc31862-7936-47df-97eb-6fe437708c3d req-b6f37021-1813-455f-8497-2c7916309747 service nova] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddc31862-7936-47df-97eb-6fe437708c3d req-b6f37021-1813-455f-8497-2c7916309747 service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ddc31862-7936-47df-97eb-6fe437708c3d req-b6f37021-1813-455f-8497-2c7916309747 service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddc31862-7936-47df-97eb-6fe437708c3d req-b6f37021-1813-455f-8497-2c7916309747 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] No waiting events found dispatching network-vif-unplugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-ddc31862-7936-47df-97eb-6fe437708c3d req-b6f37021-1813-455f-8497-2c7916309747 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-vif-unplugged-f88b95e7-ed1a-439d-922c-cf029de24af5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Instance destroyed successfully.
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.objects.instance [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'resources' on Instance uuid 15c90a37-9b63-4007-ae86-6a04d83b5093 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-396850165',display_name='tempest-TestVolumeBootPattern-volume-backed-server-396850165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-396850165',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIJjTe3lJabgYto1W4g3TitctKXFDIuHjpVdObouT0MOZfMphf5GG1JZVPk4lQLyhu2R7D/Ta7JgZntd231/w6wMswwPgQbi5ZxXKgYYAe9LcviRKpYaNOCWMe51UgNrQ==',key_name='tempest-keypair-759394887',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-qofs0tu1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=15c90a37-9b63-4007-ae86-6a04d83b5093,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "f88b95e7-ed1a-439d-922c-cf029de24af5", "address": "fa:16:3e:65:13:fa", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf88b95e7-ed", "ovs_interfaceid": "f88b95e7-ed1a-439d-922c-cf029de24af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_vif [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf88b95e7-ed, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:06 user nova-compute[72793]: INFO os_vif [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:13:fa,bridge_name='br-int',has_traffic_filtering=True,id=f88b95e7-ed1a-439d-922c-cf029de24af5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf88b95e7-ed')
Aug 17 04:43:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkSzIXTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:43:06 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e099b1-9e5a-4fb2-9c3b-1299e00eb75d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[249bdd28-5988-47e9-a5e1-c58077bb7cb2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:43:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 (non-flash)
Aug 17 04:43:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d02bd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733423e-017f-4541-8068-960eb0d76c4b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d1030a-af2b-4ad5-b448-b27e94a1c9fb]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ec0627-cd64-4e79-93db-1522fc7b5323]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[291df0d3-8c5b-4f0d-85f5-7376e1db3f51]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cddefedd', '/dev/disk/by-id/scsi-1SCST_BIOcddefedd-0e900532e051e483', '/dev/disk/by-id/scsi-23065393030353332') {{(pid=84011) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3210d7-f4f1-4a1d-84a5-2a0d3c415990]: (4, None) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf520832-5cd7-4504-ae20-0a034a05a6e4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e414fb73-d660-405b-a030-99d26a550074]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260]
Aug 17 04:43:06 user nova-compute[72793]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01, portal: 172.16.0.220,3260] successful.
Aug 17 04:43:06 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:43:06 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9e478e5-ae8c-438d-990f-ea351dc09a01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46951ae-5341-43ef-a3e2-7ab572c4a0fb]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== disconnect_volume: return (285ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:43:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Deleting instance files /opt/stack/data/nova/instances/15c90a37-9b63-4007-ae86-6a04d83b5093_del
Aug 17 04:43:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Deletion of /opt/stack/data/nova/instances/15c90a37-9b63-4007-ae86-6a04d83b5093_del complete
Aug 17 04:43:07 user nova-compute[72793]: INFO nova.compute.manager [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 17 04:43:07 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:43:07 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:43:08 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Took 0.93 seconds to deallocate network for instance.
Aug 17 04:43:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-5671a38c-4851-4c99-aafa-48537a2cee57 req-725493fa-747a-4562-9fb3-897c3c9d055e service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-vif-deleted-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-1719f7f2-40c0-48c7-9334-b515fc5770bf req-67e629c9-b991-4bf2-8f13-63393be16950 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received event network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1719f7f2-40c0-48c7-9334-b515fc5770bf req-67e629c9-b991-4bf2-8f13-63393be16950 service nova] Acquiring lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1719f7f2-40c0-48c7-9334-b515fc5770bf req-67e629c9-b991-4bf2-8f13-63393be16950 service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-1719f7f2-40c0-48c7-9334-b515fc5770bf req-67e629c9-b991-4bf2-8f13-63393be16950 service nova] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-1719f7f2-40c0-48c7-9334-b515fc5770bf req-67e629c9-b991-4bf2-8f13-63393be16950 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] No waiting events found dispatching network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:08 user nova-compute[72793]: WARNING nova.compute.manager [req-1719f7f2-40c0-48c7-9334-b515fc5770bf req-67e629c9-b991-4bf2-8f13-63393be16950 service nova] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Received unexpected event network-vif-plugged-f88b95e7-ed1a-439d-922c-cf029de24af5 for instance with vm_state active and task_state deleting.
Aug 17 04:43:08 user nova-compute[72793]: INFO nova.compute.manager [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 04:43:08 user nova-compute[72793]: DEBUG nova.compute.manager [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Deleting volume: b9e478e5-ae8c-438d-990f-ea351dc09a01 {{(pid=72793) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:09 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:43:09 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:43:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:09 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Deleted allocations for instance 15c90a37-9b63-4007-ae86-6a04d83b5093
Aug 17 04:43:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-0291d2dd-9534-4624-a138-f5f2686b8bae tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "15c90a37-9b63-4007-ae86-6a04d83b5093" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.246s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:21 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247386.6868217, 15c90a37-9b63-4007-ae86-6a04d83b5093 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:43:21 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] VM Stopped (Lifecycle Event)
Aug 17 04:43:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-05b09b7c-7826-4387-a4d3-7da42345ad8d None None] [instance: 15c90a37-9b63-4007-ae86-6a04d83b5093] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:43:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:43:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:43:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:43:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:36 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:43:36 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.297943115234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:43:36 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:43:37 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:43:37 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:46 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:43:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating instance_info_cache with network_info: [{"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:43:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:55 user nova-compute[72793]: INFO nova.compute.manager [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Terminating instance
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4009929-c325-40d9-a607-e9ee805ede2d req-17901e73-8b48-4ce6-b0ac-c94afda785f6 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-unplugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4009929-c325-40d9-a607-e9ee805ede2d req-17901e73-8b48-4ce6-b0ac-c94afda785f6 service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4009929-c325-40d9-a607-e9ee805ede2d req-17901e73-8b48-4ce6-b0ac-c94afda785f6 service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-e4009929-c325-40d9-a607-e9ee805ede2d req-17901e73-8b48-4ce6-b0ac-c94afda785f6 service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4009929-c325-40d9-a607-e9ee805ede2d req-17901e73-8b48-4ce6-b0ac-c94afda785f6 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-unplugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-e4009929-c325-40d9-a607-e9ee805ede2d req-17901e73-8b48-4ce6-b0ac-c94afda785f6 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-unplugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:55 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Instance destroyed successfully.
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lazy-loading 'resources' on Instance uuid 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-374948617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3749486',id=48,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWpYNioPly/iKvseu8FhZ+NwyGtTu2q0hfP6gZlULjCa5YV8NbnacTfMyA86jFk5/cX/q2oxpz9i8W/6mOn4pwbMhP+OcEjMXiRbrXJGcCBNZe0y4185vODDmZwnYfeg==',key_name='tempest-keypair-623108985',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3241396d2e934d7cb1bcb8d16e00e4e6',ramdisk_id='',reservation_id='r-6wtbucyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-776435379',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f06771933e20420492746df80977e210',uuid=4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Converting VIF {"id": "239edbf2-ab33-45dd-9d23-713abbe222e5", "address": "fa:16:3e:98:01:86", "network": {"id": "aa5be368-9cf3-46a7-a954-f3beb92981b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1737264683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3241396d2e934d7cb1bcb8d16e00e4e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap239edbf2-ab", "ovs_interfaceid": "239edbf2-ab33-45dd-9d23-713abbe222e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG os_vif [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:43:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap239edbf2-ab, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:43:56 user nova-compute[72793]: INFO os_vif [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:01:86,bridge_name='br-int',has_traffic_filtering=True,id=239edbf2-ab33-45dd-9d23-713abbe222e5,network=Network(aa5be368-9cf3-46a7-a954-f3beb92981b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap239edbf2-ab')
Aug 17 04:43:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Deleting instance files /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd_del
Aug 17 04:43:56 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Deletion of /opt/stack/data/nova/instances/4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd_del complete
Aug 17 04:43:56 user nova-compute[72793]: INFO nova.compute.manager [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 04:43:56 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:43:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:43:57 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Took 1.48 seconds to deallocate network for instance.
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:57 user nova-compute[72793]: WARNING nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received unexpected event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with vm_state active and task_state deleting.
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:57 user nova-compute[72793]: WARNING nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received unexpected event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with vm_state active and task_state deleting.
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:57 user nova-compute[72793]: WARNING nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received unexpected event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with vm_state active and task_state deleting.
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-unplugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-unplugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-unplugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-deleted-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:57 user nova-compute[72793]: INFO nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Neutron deleted interface 239edbf2-ab33-45dd-9d23-713abbe222e5; detaching it from the instance and deleting it from the info cache
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-b6f22ac6-2803-42d3-b14c-8e84db5ad04b req-a9f86f1c-725b-4805-a6cf-a0dad9a78a8c service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Detach interface failed, port_id=239edbf2-ab33-45dd-9d23-713abbe222e5, reason: Instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd could not be found. {{(pid=72793) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:57 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Deleted allocations for instance 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-c088ad42-d5fa-42e3-899d-16793943e7dc tempest-TestServerVolumeAttachScenarioOldVersion-776435379 tempest-TestServerVolumeAttachScenarioOldVersion-776435379-project-member] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:43:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-192943bb-bccb-4be8-aadd-1455743b68f3 req-745d2e1c-7ccc-48fd-bd30-3e542667edc5 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:43:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-192943bb-bccb-4be8-aadd-1455743b68f3 req-745d2e1c-7ccc-48fd-bd30-3e542667edc5 service nova] Acquiring lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:43:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-192943bb-bccb-4be8-aadd-1455743b68f3 req-745d2e1c-7ccc-48fd-bd30-3e542667edc5 service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:43:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-192943bb-bccb-4be8-aadd-1455743b68f3 req-745d2e1c-7ccc-48fd-bd30-3e542667edc5 service nova] Lock "4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:43:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-192943bb-bccb-4be8-aadd-1455743b68f3 req-745d2e1c-7ccc-48fd-bd30-3e542667edc5 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] No waiting events found dispatching network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:43:59 user nova-compute[72793]: WARNING nova.compute.manager [req-192943bb-bccb-4be8-aadd-1455743b68f3 req-745d2e1c-7ccc-48fd-bd30-3e542667edc5 service nova] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Received unexpected event network-vif-plugged-239edbf2-ab33-45dd-9d23-713abbe222e5 for instance with vm_state deleted and task_state None.
Aug 17 04:44:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:44:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:44:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:44:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:44:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:44:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "bf78a496-c575-4e7a-a220-e49234cc223f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:44:10 user nova-compute[72793]: INFO nova.compute.claims [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Claim successful on node user
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.network.neutron [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:44:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:44:10 user nova-compute[72793]: INFO nova.virt.block_device [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Booting with volume 8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b at /dev/vda
Aug 17 04:44:10 user nova-compute[72793]: DEBUG os_brick.utils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64c564-50ab-44d3-a95a-5ba08c51a0d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac4fd00-de84-4ffb-bf5b-06e31104ada7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[861fa752-9420-4264-b12e-12b99e598b38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2215d8-d991-431b-bd49-ad68ee6bde61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:44:10 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:44:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1488b073-4796-48f6-9e8d-55b7280701a7]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG os_brick.utils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating existing volume attachment record: 5bb34991-6f1b-4b38-9884-312fb3e63a79 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247435.971371, 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:44:10 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] VM Stopped (Lifecycle Event)
Aug 17 04:44:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-70e5896c-1d87-4d85-81ce-838f2af0b38a None None] [instance: 4118eec6-cc7d-49a0-a2ec-d0e75bc26cfd] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:44:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:44:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:44:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:44:11 user nova-compute[72793]: DEBUG nova.policy [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ac4e1570914524a592a7a67453bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d3627ce05643749885c08563fbe747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:44:11 user nova-compute[72793]: DEBUG nova.network.neutron [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Successfully created port: 0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Successfully updated port: 0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquired lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-changed-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG nova.compute.manager [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Refreshing instance network info cache due to event network-changed-0ac928aa-6f1b-48de-a128-b7b775d6d5c2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] Acquiring lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:44:12 user nova-compute[72793]: DEBUG nova.network.neutron [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG nova.network.neutron [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating instance_info_cache with network_info: [{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Releasing lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Instance network_info: |[{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] Acquired lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Refreshing network info cache for port 0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updated VIF entry in instance network info cache for port 0ac928aa-6f1b-48de-a128-b7b775d6d5c2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating instance_info_cache with network_info: [{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:44:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-45dfcec8-441a-4446-baaf-8e5b924d1af5 req-b0c838d7-9e0c-4b98-ae3e-3b3e5102168b service nova] Releasing lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:44:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:44:20 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Creating image(s)
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Ensure instance console log exists: /opt/stack/data/nova/instances/bf78a496-c575-4e7a-a220-e49234cc223f/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Start _get_guest_xml network_info=[{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf78a496-c575-4e7a-a220-e49234cc223f', 'attached_at': '', 'detached_at': '', 'volume_id': '8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b', 'serial': '8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'}, 'guest_format': None, 'attachment_id': '5bb34991-6f1b-4b38-9884-312fb3e63a79', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:44:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:44:20 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:44:20 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:44:20 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:44:20 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[57393abd-e860-48a1-8046-1ecb60acc695]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:44:20 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2d078-00c8-45fa-89c0-178538f15f64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b] added
Aug 17 04:44:20 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[83edea41-4466-4408-9aad-83596be51c4e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c280147c-5c66-4e62-bb6d-8725e4a3ca7d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwAWbdXF {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwAWbdXF" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ac3a82-c747-4ad4-b6d5-f22a89e98f6f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwAWbdXF'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a44ad1-740d-4e99-adad-f2d37481c29e]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f27d1f-81fa-4632-82dd-0fefee7a65b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:44:20 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:44:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:44:20 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:44:20 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:44:20 user nova-compute[72793]: 
Aug 17 04:44:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b4d81b-1f20-4e8f-bab1-fa30da8e3195]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]
Aug 17 04:44:21 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.
Aug 17 04:44:21 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[965ffb06-8db6-4e1b-9cbc-5d39a339da28]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c398a1-d8e7-430b-88f1-eff998d7c4f7]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:44:21 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:44:21 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33c1a8-331a-4496-b50d-3fae2b5cd7fc]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:44:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23930643134323239', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930643134323239', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-718166292',display_name='tempest-TestVolumeBootPattern-server-718166292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-718166292',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-vrqkpgxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:44:10Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=bf78a496-c575-4e7a-a220-e49234cc223f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.objects.instance [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'pci_devices' on Instance uuid bf78a496-c575-4e7a-a220-e49234cc223f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:44:22 user nova-compute[72793]:   <uuid>bf78a496-c575-4e7a-a220-e49234cc223f</uuid>
Aug 17 04:44:22 user nova-compute[72793]:   <name>instance-00000031</name>
Aug 17 04:44:22 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:44:22 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:44:22 user nova-compute[72793]:   <metadata>
Aug 17 04:44:22 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:44:22 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:44:22 user nova-compute[72793]:       <nova:name>tempest-TestVolumeBootPattern-server-718166292</nova:name>
Aug 17 04:44:22 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:44:20</nova:creationTime>
Aug 17 04:44:22 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:44:22 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:44:22 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:44:22 user nova-compute[72793]:       <nova:owner>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:user uuid="a0ac4e1570914524a592a7a67453bcc3">tempest-TestVolumeBootPattern-2127448763-project-member</nova:user>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:project uuid="f6d3627ce05643749885c08563fbe747">tempest-TestVolumeBootPattern-2127448763</nova:project>
Aug 17 04:44:22 user nova-compute[72793]:       </nova:owner>
Aug 17 04:44:22 user nova-compute[72793]:       <nova:ports>
Aug 17 04:44:22 user nova-compute[72793]:         <nova:port uuid="0ac928aa-6f1b-48de-a128-b7b775d6d5c2">
Aug 17 04:44:22 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 04:44:22 user nova-compute[72793]:         </nova:port>
Aug 17 04:44:22 user nova-compute[72793]:       </nova:ports>
Aug 17 04:44:22 user nova-compute[72793]:     </nova:instance>
Aug 17 04:44:22 user nova-compute[72793]:   </metadata>
Aug 17 04:44:22 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:44:22 user nova-compute[72793]:     <system>
Aug 17 04:44:22 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:44:22 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:44:22 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:44:22 user nova-compute[72793]:       <entry name="serial">bf78a496-c575-4e7a-a220-e49234cc223f</entry>
Aug 17 04:44:22 user nova-compute[72793]:       <entry name="uuid">bf78a496-c575-4e7a-a220-e49234cc223f</entry>
Aug 17 04:44:22 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:44:22 user nova-compute[72793]:     </system>
Aug 17 04:44:22 user nova-compute[72793]:   </sysinfo>
Aug 17 04:44:22 user nova-compute[72793]:   <os>
Aug 17 04:44:22 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:44:22 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:44:22 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:44:22 user nova-compute[72793]:   </os>
Aug 17 04:44:22 user nova-compute[72793]:   <features>
Aug 17 04:44:22 user nova-compute[72793]:     <acpi/>
Aug 17 04:44:22 user nova-compute[72793]:     <apic/>
Aug 17 04:44:22 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:44:22 user nova-compute[72793]:   </features>
Aug 17 04:44:22 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:44:22 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:44:22 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:44:22 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:44:22 user nova-compute[72793]:   </clock>
Aug 17 04:44:22 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:44:22 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:44:22 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:44:22 user nova-compute[72793]:   </cpu>
Aug 17 04:44:22 user nova-compute[72793]:   <devices>
Aug 17 04:44:22 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:44:22 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:44:22 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:44:22 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:44:22 user nova-compute[72793]:       <serial>8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b</serial>
Aug 17 04:44:22 user nova-compute[72793]:     </disk>
Aug 17 04:44:22 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:44:22 user nova-compute[72793]:       <mac address="fa:16:3e:ce:ed:fd"/>
Aug 17 04:44:22 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:44:22 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:44:22 user nova-compute[72793]:       <target dev="tap0ac928aa-6f"/>
Aug 17 04:44:22 user nova-compute[72793]:     </interface>
Aug 17 04:44:22 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:44:22 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/bf78a496-c575-4e7a-a220-e49234cc223f/console.log" append="off"/>
Aug 17 04:44:22 user nova-compute[72793]:     </serial>
Aug 17 04:44:22 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:44:22 user nova-compute[72793]:     <video>
Aug 17 04:44:22 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:44:22 user nova-compute[72793]:     </video>
Aug 17 04:44:22 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:44:22 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:44:22 user nova-compute[72793]:     </rng>
Aug 17 04:44:22 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:44:22 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:44:22 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:44:22 user nova-compute[72793]:     </memballoon>
Aug 17 04:44:22 user nova-compute[72793]:   </devices>
Aug 17 04:44:22 user nova-compute[72793]: </domain>
Aug 17 04:44:22 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-718166292',display_name='tempest-TestVolumeBootPattern-server-718166292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-718166292',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-vrqkpgxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:44:10Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=bf78a496-c575-4e7a-a220-e49234cc223f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG os_vif [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ac928aa-6f, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ac928aa-6f, col_values=(('external_ids', {'iface-id': '0ac928aa-6f1b-48de-a128-b7b775d6d5c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ed:fd', 'vm-uuid': 'bf78a496-c575-4e7a-a220-e49234cc223f'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:22 user nova-compute[72793]: INFO os_vif [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f')
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:44:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No VIF found with MAC fa:16:3e:ce:ed:fd, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-75014dc8-5293-4651-af47-6a330f9015e7 req-13fea55d-c291-476f-9fe1-14de1d15ce07 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75014dc8-5293-4651-af47-6a330f9015e7 req-13fea55d-c291-476f-9fe1-14de1d15ce07 service nova] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75014dc8-5293-4651-af47-6a330f9015e7 req-13fea55d-c291-476f-9fe1-14de1d15ce07 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-75014dc8-5293-4651-af47-6a330f9015e7 req-13fea55d-c291-476f-9fe1-14de1d15ce07 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-75014dc8-5293-4651-af47-6a330f9015e7 req-13fea55d-c291-476f-9fe1-14de1d15ce07 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] No waiting events found dispatching network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:44:23 user nova-compute[72793]: WARNING nova.compute.manager [req-75014dc8-5293-4651-af47-6a330f9015e7 req-13fea55d-c291-476f-9fe1-14de1d15ce07 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received unexpected event network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 for instance with vm_state building and task_state spawning.
Aug 17 04:44:23 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid bf78a496-c575-4e7a-a220-e49234cc223f {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:44:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247465.5124428, bf78a496-c575-4e7a-a220-e49234cc223f => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] VM Resumed (Lifecycle Event)
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Instance spawned successfully.
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247465.5148659, bf78a496-c575-4e7a-a220-e49234cc223f => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] VM Started (Lifecycle Event)
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Took 15.60 seconds to build instance.
Aug 17 04:44:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-966ded32-80cb-40ee-aa89-3a838d6220a0 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "bf78a496-c575-4e7a-a220-e49234cc223f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.692s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "bf78a496-c575-4e7a-a220-e49234cc223f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.852s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:25 user nova-compute[72793]: INFO nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:44:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "bf78a496-c575-4e7a-a220-e49234cc223f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa0e69a3-c5f1-4952-83fa-8616936f8f94 req-3583983e-df17-44e6-9cd6-5dd6e9e4cfb3 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa0e69a3-c5f1-4952-83fa-8616936f8f94 req-3583983e-df17-44e6-9cd6-5dd6e9e4cfb3 service nova] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa0e69a3-c5f1-4952-83fa-8616936f8f94 req-3583983e-df17-44e6-9cd6-5dd6e9e4cfb3 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-aa0e69a3-c5f1-4952-83fa-8616936f8f94 req-3583983e-df17-44e6-9cd6-5dd6e9e4cfb3 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-aa0e69a3-c5f1-4952-83fa-8616936f8f94 req-3583983e-df17-44e6-9cd6-5dd6e9e4cfb3 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] No waiting events found dispatching network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:44:25 user nova-compute[72793]: WARNING nova.compute.manager [req-aa0e69a3-c5f1-4952-83fa-8616936f8f94 req-3583983e-df17-44e6-9cd6-5dd6e9e4cfb3 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received unexpected event network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 for instance with vm_state active and task_state None.
Aug 17 04:44:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:44:38 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:44:38 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=25.315528869628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance bf78a496-c575-4e7a-a220-e49234cc223f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:44:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:44:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:41 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:45 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:44:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:44:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:44:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid bf78a496-c575-4e7a-a220-e49234cc223f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating instance_info_cache with network_info: [{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:44:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:44:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:44:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:37 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:45:38 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:45:38 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.314353942871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance bf78a496-c575-4e7a-a220-e49234cc223f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:45:38 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:45:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid bf78a496-c575-4e7a-a220-e49234cc223f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating instance_info_cache with network_info: [{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:45:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:45:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:45:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:45:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:45:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:45:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-changed-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Refreshing instance network info cache due to event network-changed-0ac928aa-6f1b-48de-a128-b7b775d6d5c2. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] Acquiring lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] Acquired lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG nova.network.neutron [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Refreshing network info cache for port 0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:46:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "bf78a496-c575-4e7a-a220-e49234cc223f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:03 user nova-compute[72793]: INFO nova.compute.manager [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Terminating instance
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updated VIF entry in instance network info cache for port 0ac928aa-6f1b-48de-a128-b7b775d6d5c2. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating instance_info_cache with network_info: [{"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-6071bc1c-23fe-44a0-b641-55a027ae49e1 req-befc83c4-6ff3-4ec8-b53b-e0ca68aa90e1 service nova] Releasing lock "refresh_cache-bf78a496-c575-4e7a-a220-e49234cc223f" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-c46d9fd9-c5b7-4b41-bdba-4b09875eb7b7 req-3fd008fa-cb92-408c-8c83-26e4bdf1eb30 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-vif-unplugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c46d9fd9-c5b7-4b41-bdba-4b09875eb7b7 req-3fd008fa-cb92-408c-8c83-26e4bdf1eb30 service nova] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c46d9fd9-c5b7-4b41-bdba-4b09875eb7b7 req-3fd008fa-cb92-408c-8c83-26e4bdf1eb30 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c46d9fd9-c5b7-4b41-bdba-4b09875eb7b7 req-3fd008fa-cb92-408c-8c83-26e4bdf1eb30 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-c46d9fd9-c5b7-4b41-bdba-4b09875eb7b7 req-3fd008fa-cb92-408c-8c83-26e4bdf1eb30 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] No waiting events found dispatching network-vif-unplugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.compute.manager [req-c46d9fd9-c5b7-4b41-bdba-4b09875eb7b7 req-3fd008fa-cb92-408c-8c83-26e4bdf1eb30 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-vif-unplugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:46:03 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Instance destroyed successfully.
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.objects.instance [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'resources' on Instance uuid bf78a496-c575-4e7a-a220-e49234cc223f {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-718166292',display_name='tempest-TestVolumeBootPattern-server-718166292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-718166292',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:44:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-vrqkpgxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:44:26Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=bf78a496-c575-4e7a-a220-e49234cc223f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "address": "fa:16:3e:ce:ed:fd", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ac928aa-6f", "ovs_interfaceid": "0ac928aa-6f1b-48de-a128-b7b775d6d5c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_vif [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ac928aa-6f, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:03 user nova-compute[72793]: INFO os_vif [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ed:fd,bridge_name='br-int',has_traffic_filtering=True,id=0ac928aa-6f1b-48de-a128-b7b775d6d5c2,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ac928aa-6f')
Aug 17 04:46:03 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:46:03 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f2bd4a-86f4-4331-b8ff-c41580f2386d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6439d3e-1cbc-451e-8d11-97addeef57c4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:46:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:46:03 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d06492d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[900a0e54-ae23-43bb-b08b-f7d20d35f503]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb08f674-abdb-4fc7-b900-aff6c4cdc7bc]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[071504a1-eadb-4299-b80c-e055af96ab0d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed7c66e-d2a5-4a58-a641-19ca1831e326]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23930643134323239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4f4c4313', '/dev/disk/by-id/scsi-1SCST_BIO4f4c4313-90d1422962995a25') {{(pid=84011) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fee7fe9-a8c0-457e-a00a-a075d06aa477]: (4, None) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc77be67-4dcd-4c97-9514-13dc27909408]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:46:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd799ef7-e76b-4585-8a62-899854cabfdb]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]
Aug 17 04:46:04 user nova-compute[72793]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.
Aug 17 04:46:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba1fe1e-b80f-4544-a485-9d22e9d87051]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== disconnect_volume: return (273ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:46:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Deleting instance files /opt/stack/data/nova/instances/bf78a496-c575-4e7a-a220-e49234cc223f_del
Aug 17 04:46:04 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Deletion of /opt/stack/data/nova/instances/bf78a496-c575-4e7a-a220-e49234cc223f_del complete
Aug 17 04:46:04 user nova-compute[72793]: INFO nova.compute.manager [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 17 04:46:04 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:46:04 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:46:05 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Took 0.99 seconds to deallocate network for instance.
Aug 17 04:46:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-e058b7c7-f4f1-4893-b8b7-0cd6b16bcbb3 req-6b678525-a3b6-4429-bcf0-8ac5d15e1c3e service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-vif-deleted-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-4be978c0-9af6-421f-a221-cee3fe2c86ae req-013d26c8-4518-4c6f-ac7d-0396c0747004 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received event network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4be978c0-9af6-421f-a221-cee3fe2c86ae req-013d26c8-4518-4c6f-ac7d-0396c0747004 service nova] Acquiring lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4be978c0-9af6-421f-a221-cee3fe2c86ae req-013d26c8-4518-4c6f-ac7d-0396c0747004 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4be978c0-9af6-421f-a221-cee3fe2c86ae req-013d26c8-4518-4c6f-ac7d-0396c0747004 service nova] Lock "bf78a496-c575-4e7a-a220-e49234cc223f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG nova.compute.manager [req-4be978c0-9af6-421f-a221-cee3fe2c86ae req-013d26c8-4518-4c6f-ac7d-0396c0747004 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] No waiting events found dispatching network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:46:05 user nova-compute[72793]: WARNING nova.compute.manager [req-4be978c0-9af6-421f-a221-cee3fe2c86ae req-013d26c8-4518-4c6f-ac7d-0396c0747004 service nova] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Received unexpected event network-vif-plugged-0ac928aa-6f1b-48de-a128-b7b775d6d5c2 for instance with vm_state active and task_state deleting.
Aug 17 04:46:05 user nova-compute[72793]: INFO nova.compute.manager [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 04:46:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:06 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:46:06 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:46:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:06 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Deleted allocations for instance bf78a496-c575-4e7a-a220-e49234cc223f
Aug 17 04:46:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-97ecf6b7-5510-45ba-b7d3-9a8dc0e843e8 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "bf78a496-c575-4e7a-a220-e49234cc223f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:18 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247563.7449996, bf78a496-c575-4e7a-a220-e49234cc223f => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:46:18 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] VM Stopped (Lifecycle Event)
Aug 17 04:46:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-fb136584-1909-42bb-abc7-11ad2bc4eb40 None None] [instance: bf78a496-c575-4e7a-a220-e49234cc223f] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:46:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:46:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:46:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.31351089477539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:46:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:46:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:46:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:46:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:46:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:46:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:46:54 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:46:54 user nova-compute[72793]: INFO nova.compute.claims [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Claim successful on node user
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:46:55 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:46:55 user nova-compute[72793]: INFO nova.virt.block_device [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Booting with volume 8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b at /dev/vda
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.policy [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ac4e1570914524a592a7a67453bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d3627ce05643749885c08563fbe747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG os_brick.utils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a152d-f5dc-4a89-8ca7-9a1c70803934]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ef14a-1cd0-4047-b994-698748d5e817]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac6733-b64f-448a-860e-39325c8c98e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dad77a-5b50-4f26-8d96-a294b7f1f628]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:46:55 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:46:55 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61edfdd2-4cfc-49ca-ae7c-02a01481e39c]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG os_brick.utils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:46:55 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating existing volume attachment record: aa3b2255-8d25-44c4-b16d-8568d75493ea {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:46:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Successfully created port: 11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:46:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Successfully updated port: 11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:46:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:46:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:46:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-changed-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Refreshing instance network info cache due to event network-changed-11fd3130-8b74-4d37-8048-a7fdbee319f3. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.network.neutron [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Instance network_info: |[{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Refreshing network info cache for port 11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated VIF entry in instance network info cache for port 11fd3130-8b74-4d37-8048-a7fdbee319f3. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:46:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ee974305-b4fd-4409-8b0b-01d4b87cfaf3 req-8dac6bc3-9b23-48bf-a437-6aa7360f3b01 service nova] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:46:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:47:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:47:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:47:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:47:05 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Creating image(s)
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Ensure instance console log exists: /opt/stack/data/nova/instances/36b02bd4-6359-4c6c-b7d1-b9458ff02348/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Start _get_guest_xml network_info=[{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '36b02bd4-6359-4c6c-b7d1-b9458ff02348', 'attached_at': '', 'detached_at': '', 'volume_id': '8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b', 'serial': '8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'}, 'guest_format': None, 'attachment_id': 'aa3b2255-8d25-44c4-b16d-8568d75493ea', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:47:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:47:05 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:47:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:47:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:47:05 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a3246-fda5-49db-8f08-73dd77ae95b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:47:05 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e4b5a8-125b-4790-b541-6be192726fdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b] added
Aug 17 04:47:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30961419-9978-46fa-800f-18545b7be61d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd50b86-e5cb-4099-813a-502523f1e0a8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwAWbdXF {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwAWbdXF" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad5ddd8-c051-4d17-b32e-d0ccfeed9087]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwAWbdXF'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc80ac9f-c38b-4f54-beb8-b46908a6faf4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[79210ee9-e989-4452-9aae-ce76f573472a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:47:05 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:47:05 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:47:05 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:47:05 user nova-compute[72793]: 
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b0ef4-5ddd-4ae7-822d-05d83a46df6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]
Aug 17 04:47:05 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.
Aug 17 04:47:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8671bc3f-5c2f-49ae-9767-bc3ccf474567]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f93bf0-5202-448b-8e50-d0c8cb949331]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:47:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:47:05 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[db040343-e8eb-49c7-a7d8-31bad5e9ad71]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:47:05 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:47:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:47:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23930643134323239', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:47:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930643134323239', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:47:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1031714815',display_name='tempest-TestVolumeBootPattern-server-1031714815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1031714815',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-rihedbb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:46:55Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=36b02bd4-6359-4c6c-b7d1-b9458ff02348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:47:06 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:47:06 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'pci_devices' on Instance uuid 36b02bd4-6359-4c6c-b7d1-b9458ff02348 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:47:07 user nova-compute[72793]:   <uuid>36b02bd4-6359-4c6c-b7d1-b9458ff02348</uuid>
Aug 17 04:47:07 user nova-compute[72793]:   <name>instance-00000032</name>
Aug 17 04:47:07 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:47:07 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:47:07 user nova-compute[72793]:   <metadata>
Aug 17 04:47:07 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:47:07 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:47:07 user nova-compute[72793]:       <nova:name>tempest-TestVolumeBootPattern-server-1031714815</nova:name>
Aug 17 04:47:07 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:47:05</nova:creationTime>
Aug 17 04:47:07 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:47:07 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:47:07 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:47:07 user nova-compute[72793]:       <nova:owner>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:user uuid="a0ac4e1570914524a592a7a67453bcc3">tempest-TestVolumeBootPattern-2127448763-project-member</nova:user>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:project uuid="f6d3627ce05643749885c08563fbe747">tempest-TestVolumeBootPattern-2127448763</nova:project>
Aug 17 04:47:07 user nova-compute[72793]:       </nova:owner>
Aug 17 04:47:07 user nova-compute[72793]:       <nova:ports>
Aug 17 04:47:07 user nova-compute[72793]:         <nova:port uuid="11fd3130-8b74-4d37-8048-a7fdbee319f3">
Aug 17 04:47:07 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 04:47:07 user nova-compute[72793]:         </nova:port>
Aug 17 04:47:07 user nova-compute[72793]:       </nova:ports>
Aug 17 04:47:07 user nova-compute[72793]:     </nova:instance>
Aug 17 04:47:07 user nova-compute[72793]:   </metadata>
Aug 17 04:47:07 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:47:07 user nova-compute[72793]:     <system>
Aug 17 04:47:07 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:47:07 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:47:07 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:47:07 user nova-compute[72793]:       <entry name="serial">36b02bd4-6359-4c6c-b7d1-b9458ff02348</entry>
Aug 17 04:47:07 user nova-compute[72793]:       <entry name="uuid">36b02bd4-6359-4c6c-b7d1-b9458ff02348</entry>
Aug 17 04:47:07 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:47:07 user nova-compute[72793]:     </system>
Aug 17 04:47:07 user nova-compute[72793]:   </sysinfo>
Aug 17 04:47:07 user nova-compute[72793]:   <os>
Aug 17 04:47:07 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:47:07 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:47:07 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:47:07 user nova-compute[72793]:   </os>
Aug 17 04:47:07 user nova-compute[72793]:   <features>
Aug 17 04:47:07 user nova-compute[72793]:     <acpi/>
Aug 17 04:47:07 user nova-compute[72793]:     <apic/>
Aug 17 04:47:07 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:47:07 user nova-compute[72793]:   </features>
Aug 17 04:47:07 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:47:07 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:47:07 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:47:07 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:47:07 user nova-compute[72793]:   </clock>
Aug 17 04:47:07 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:47:07 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:47:07 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:47:07 user nova-compute[72793]:   </cpu>
Aug 17 04:47:07 user nova-compute[72793]:   <devices>
Aug 17 04:47:07 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:47:07 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:47:07 user nova-compute[72793]:       <source dev="/dev/sdb"/>
Aug 17 04:47:07 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:47:07 user nova-compute[72793]:       <serial>8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b</serial>
Aug 17 04:47:07 user nova-compute[72793]:     </disk>
Aug 17 04:47:07 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:47:07 user nova-compute[72793]:       <mac address="fa:16:3e:26:da:eb"/>
Aug 17 04:47:07 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:47:07 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:47:07 user nova-compute[72793]:       <target dev="tap11fd3130-8b"/>
Aug 17 04:47:07 user nova-compute[72793]:     </interface>
Aug 17 04:47:07 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:47:07 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/36b02bd4-6359-4c6c-b7d1-b9458ff02348/console.log" append="off"/>
Aug 17 04:47:07 user nova-compute[72793]:     </serial>
Aug 17 04:47:07 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:47:07 user nova-compute[72793]:     <video>
Aug 17 04:47:07 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:47:07 user nova-compute[72793]:     </video>
Aug 17 04:47:07 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:47:07 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:47:07 user nova-compute[72793]:     </rng>
Aug 17 04:47:07 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:47:07 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:47:07 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:47:07 user nova-compute[72793]:     </memballoon>
Aug 17 04:47:07 user nova-compute[72793]:   </devices>
Aug 17 04:47:07 user nova-compute[72793]: </domain>
Aug 17 04:47:07 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1031714815',display_name='tempest-TestVolumeBootPattern-server-1031714815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1031714815',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-rihedbb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:46:55Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=36b02bd4-6359-4c6c-b7d1-b9458ff02348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG os_vif [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11fd3130-8b, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11fd3130-8b, col_values=(('external_ids', {'iface-id': '11fd3130-8b74-4d37-8048-a7fdbee319f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:da:eb', 'vm-uuid': '36b02bd4-6359-4c6c-b7d1-b9458ff02348'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:07 user nova-compute[72793]: INFO os_vif [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b')
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:47:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No VIF found with MAC fa:16:3e:26:da:eb, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-0e8c99d5-6472-4097-898f-ebf33dd649da req-320f088a-f6c1-4e2c-ad03-59c6006e496e service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0e8c99d5-6472-4097-898f-ebf33dd649da req-320f088a-f6c1-4e2c-ad03-59c6006e496e service nova] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0e8c99d5-6472-4097-898f-ebf33dd649da req-320f088a-f6c1-4e2c-ad03-59c6006e496e service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0e8c99d5-6472-4097-898f-ebf33dd649da req-320f088a-f6c1-4e2c-ad03-59c6006e496e service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-0e8c99d5-6472-4097-898f-ebf33dd649da req-320f088a-f6c1-4e2c-ad03-59c6006e496e service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] No waiting events found dispatching network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:47:08 user nova-compute[72793]: WARNING nova.compute.manager [req-0e8c99d5-6472-4097-898f-ebf33dd649da req-320f088a-f6c1-4e2c-ad03-59c6006e496e service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received unexpected event network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 for instance with vm_state building and task_state spawning.
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247630.397758, 36b02bd4-6359-4c6c-b7d1-b9458ff02348 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] VM Resumed (Lifecycle Event)
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Instance spawned successfully.
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247630.4002097, 36b02bd4-6359-4c6c-b7d1-b9458ff02348 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] VM Started (Lifecycle Event)
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-40827a7d-434e-446d-a160-13d23773c91e req-95fef493-7282-4c53-96e2-4b047d1070f3 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-40827a7d-434e-446d-a160-13d23773c91e req-95fef493-7282-4c53-96e2-4b047d1070f3 service nova] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-40827a7d-434e-446d-a160-13d23773c91e req-95fef493-7282-4c53-96e2-4b047d1070f3 service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-40827a7d-434e-446d-a160-13d23773c91e req-95fef493-7282-4c53-96e2-4b047d1070f3 service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:47:10 user nova-compute[72793]: DEBUG nova.compute.manager [req-40827a7d-434e-446d-a160-13d23773c91e req-95fef493-7282-4c53-96e2-4b047d1070f3 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] No waiting events found dispatching network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:47:10 user nova-compute[72793]: WARNING nova.compute.manager [req-40827a7d-434e-446d-a160-13d23773c91e req-95fef493-7282-4c53-96e2-4b047d1070f3 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received unexpected event network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 for instance with vm_state active and task_state None.
Aug 17 04:47:10 user nova-compute[72793]: INFO nova.compute.manager [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Took 15.67 seconds to build instance.
Aug 17 04:47:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-977c6141-a645-49e4-ba9c-8d9a06c96f9f tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.761s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:47:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:47:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:47:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.311805725097656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 36b02bd4-6359-4c6c-b7d1-b9458ff02348 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:47:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:47:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:47:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:47:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:47:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:47:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:47:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:47:50 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:47:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:47:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:47:51 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:47:51 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 36b02bd4-6359-4c6c-b7d1-b9458ff02348 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:47:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:47:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:47:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:47:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:47:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:47:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:47:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:47:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:47:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:48:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:48:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:48:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:48:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:48:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:48:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:48:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:48:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:48:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:38 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:48:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:48:39 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.311264038085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 36b02bd4-6359-4c6c-b7d1-b9458ff02348 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:48:39 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:48:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:48:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:45 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-changed-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:48:46 user nova-compute[72793]: DEBUG nova.compute.manager [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Refreshing instance network info cache due to event network-changed-11fd3130-8b74-4d37-8048-a7fdbee319f3. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:48:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:48:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:48:46 user nova-compute[72793]: DEBUG nova.network.neutron [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Refreshing network info cache for port 11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:48:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated VIF entry in instance network info cache for port 11fd3130-8b74-4d37-8048-a7fdbee319f3. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:48:47 user nova-compute[72793]: DEBUG nova.network.neutron [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:48:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4249413f-04df-41a3-b6a7-00b979c95044 req-544abdad-9db0-4236-8890-52665a1408f0 service nova] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:48:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:48 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:48:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:48:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 36b02bd4-6359-4c6c-b7d1-b9458ff02348 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:48:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:48:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:48:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:48:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:48:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:49:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:00 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:49:00 user nova-compute[72793]: INFO nova.compute.claims [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Claim successful on node user
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:49:01 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:49:01 user nova-compute[72793]: INFO nova.virt.block_device [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Booting with volume aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd at /dev/vda
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.policy [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ac4e1570914524a592a7a67453bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d3627ce05643749885c08563fbe747', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG os_brick.utils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb82b8-f3a2-4aba-b0a5-8d8ee6074711]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af6c92-505a-4be6-b733-dd7246229f6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[312858a8-d648-44d7-898f-05a20422cef3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4133c69-410b-42a1-bd76-35cc3a4bcd0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:49:01 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:49:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[737b2178-d2e9-477c-8240-baef93f15b45]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG os_brick.utils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:49:01 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating existing volume attachment record: 724dd9a6-a85d-4e0d-8b94-a894a0e7cd37 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Successfully created port: a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Successfully updated port: a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquired lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-changed-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG nova.compute.manager [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Refreshing instance network info cache due to event network-changed-a7d38b0d-c307-4de0-956b-d8f6ab2422c5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] Acquiring lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:49:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating instance_info_cache with network_info: [{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Releasing lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Instance network_info: |[{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] Acquired lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Refreshing network info cache for port a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updated VIF entry in instance network info cache for port a7d38b0d-c307-4de0-956b-d8f6ab2422c5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG nova.network.neutron [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating instance_info_cache with network_info: [{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:49:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-ada15553-7af4-4fe8-8825-88a998f53886 req-ab23c8b6-c850-46c5-a0fe-92d9d098bc39 service nova] Releasing lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:49:11 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Creating image(s)
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Did not create local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Ensure instance console log exists: /opt/stack/data/nova/instances/62d54f11-b0da-41f6-a29a-8c6f221a9b57/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Start _get_guest_xml network_info=[{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DverxnNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62d54f11-b0da-41f6-a29a-8c6f221a9b57', 'attached_at': '', 'detached_at': '', 'volume_id': 'aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd', 'serial': 'aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd'}, 'guest_format': None, 'attachment_id': '724dd9a6-a85d-4e0d-8b94-a894a0e7cd37', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:49:11 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:49:11 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DverxnNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:49:11 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:49:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:49:11 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:49:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:49:11 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:49:12 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3847ab13-465e-4a40-bce6-dc2c9f8953cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:49:12 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58a5513-154b-48b4-9213-dc0698b24d10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd] added
Aug 17 04:49:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e16973-3f9f-44b0-9ed1-df2251c695cc]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b154936-ad62-4eba-80c9-dc3f2e0a56c9]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DverxnNE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DverxnNE" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f71a2d-1f9f-405a-9462-f1f8e92e8812]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DverxnNE'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[311cdacd-0256-4426-ad01-887f20f0e004]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35a2d04-f0bb-4d0f-b243-339d88dca848]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:49:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:49:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc21d1b-54d4-4875-9387-b528ca8edf3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260]
Aug 17 04:49:12 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260] successful.
Aug 17 04:49:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf444b7-c03c-4f55-81eb-f549e15f8745]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66b8e1-b90b-4fef-81cc-2d7c1f91e274]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:49:12 user nova-compute[72793]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd (non-flash)
Aug 17 04:49:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:49:12 user nova-compute[72793]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd (non-flash)
Aug 17 04:49:12 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[faebee89-a3d9-46ab-b54c-adb7cd836a70]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:49:12 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DverxnNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23135633535376639', 'path': '/dev/sdc'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135633535376639', 'path': '/dev/sdc'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-703646000',display_name='tempest-TestVolumeBootPattern-server-703646000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-703646000',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-whi7elka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:49:01Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=62d54f11-b0da-41f6-a29a-8c6f221a9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'pci_devices' on Instance uuid 62d54f11-b0da-41f6-a29a-8c6f221a9b57 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:49:13 user nova-compute[72793]:   <uuid>62d54f11-b0da-41f6-a29a-8c6f221a9b57</uuid>
Aug 17 04:49:13 user nova-compute[72793]:   <name>instance-00000033</name>
Aug 17 04:49:13 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:49:13 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:49:13 user nova-compute[72793]:   <metadata>
Aug 17 04:49:13 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:49:13 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:49:13 user nova-compute[72793]:       <nova:name>tempest-TestVolumeBootPattern-server-703646000</nova:name>
Aug 17 04:49:13 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:49:11</nova:creationTime>
Aug 17 04:49:13 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:49:13 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:49:13 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:49:13 user nova-compute[72793]:       <nova:owner>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:user uuid="a0ac4e1570914524a592a7a67453bcc3">tempest-TestVolumeBootPattern-2127448763-project-member</nova:user>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:project uuid="f6d3627ce05643749885c08563fbe747">tempest-TestVolumeBootPattern-2127448763</nova:project>
Aug 17 04:49:13 user nova-compute[72793]:       </nova:owner>
Aug 17 04:49:13 user nova-compute[72793]:       <nova:ports>
Aug 17 04:49:13 user nova-compute[72793]:         <nova:port uuid="a7d38b0d-c307-4de0-956b-d8f6ab2422c5">
Aug 17 04:49:13 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 04:49:13 user nova-compute[72793]:         </nova:port>
Aug 17 04:49:13 user nova-compute[72793]:       </nova:ports>
Aug 17 04:49:13 user nova-compute[72793]:     </nova:instance>
Aug 17 04:49:13 user nova-compute[72793]:   </metadata>
Aug 17 04:49:13 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:49:13 user nova-compute[72793]:     <system>
Aug 17 04:49:13 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:49:13 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:49:13 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:49:13 user nova-compute[72793]:       <entry name="serial">62d54f11-b0da-41f6-a29a-8c6f221a9b57</entry>
Aug 17 04:49:13 user nova-compute[72793]:       <entry name="uuid">62d54f11-b0da-41f6-a29a-8c6f221a9b57</entry>
Aug 17 04:49:13 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:49:13 user nova-compute[72793]:     </system>
Aug 17 04:49:13 user nova-compute[72793]:   </sysinfo>
Aug 17 04:49:13 user nova-compute[72793]:   <os>
Aug 17 04:49:13 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:49:13 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:49:13 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:49:13 user nova-compute[72793]:   </os>
Aug 17 04:49:13 user nova-compute[72793]:   <features>
Aug 17 04:49:13 user nova-compute[72793]:     <acpi/>
Aug 17 04:49:13 user nova-compute[72793]:     <apic/>
Aug 17 04:49:13 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:49:13 user nova-compute[72793]:   </features>
Aug 17 04:49:13 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:49:13 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:49:13 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:49:13 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:49:13 user nova-compute[72793]:   </clock>
Aug 17 04:49:13 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:49:13 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:49:13 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:49:13 user nova-compute[72793]:   </cpu>
Aug 17 04:49:13 user nova-compute[72793]:   <devices>
Aug 17 04:49:13 user nova-compute[72793]:     <disk type="block" device="disk">
Aug 17 04:49:13 user nova-compute[72793]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:49:13 user nova-compute[72793]:       <source dev="/dev/sdc"/>
Aug 17 04:49:13 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:49:13 user nova-compute[72793]:       <serial>aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd</serial>
Aug 17 04:49:13 user nova-compute[72793]:     </disk>
Aug 17 04:49:13 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:49:13 user nova-compute[72793]:       <mac address="fa:16:3e:13:45:73"/>
Aug 17 04:49:13 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:49:13 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:49:13 user nova-compute[72793]:       <target dev="tapa7d38b0d-c3"/>
Aug 17 04:49:13 user nova-compute[72793]:     </interface>
Aug 17 04:49:13 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:49:13 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/62d54f11-b0da-41f6-a29a-8c6f221a9b57/console.log" append="off"/>
Aug 17 04:49:13 user nova-compute[72793]:     </serial>
Aug 17 04:49:13 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:49:13 user nova-compute[72793]:     <video>
Aug 17 04:49:13 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:49:13 user nova-compute[72793]:     </video>
Aug 17 04:49:13 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:49:13 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:49:13 user nova-compute[72793]:     </rng>
Aug 17 04:49:13 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:49:13 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:49:13 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:49:13 user nova-compute[72793]:     </memballoon>
Aug 17 04:49:13 user nova-compute[72793]:   </devices>
Aug 17 04:49:13 user nova-compute[72793]: </domain>
Aug 17 04:49:13 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-703646000',display_name='tempest-TestVolumeBootPattern-server-703646000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-703646000',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-whi7elka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:49:01Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=62d54f11-b0da-41f6-a29a-8c6f221a9b57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG os_vif [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7d38b0d-c3, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7d38b0d-c3, col_values=(('external_ids', {'iface-id': 'a7d38b0d-c307-4de0-956b-d8f6ab2422c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:45:73', 'vm-uuid': '62d54f11-b0da-41f6-a29a-8c6f221a9b57'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:13 user nova-compute[72793]: INFO os_vif [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3')
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:49:13 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] No VIF found with MAC fa:16:3e:13:45:73, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-7f2a0895-fcf3-46f7-b84e-db486fd6a8e9 req-df047faa-519e-434f-915b-38865b0e6001 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7f2a0895-fcf3-46f7-b84e-db486fd6a8e9 req-df047faa-519e-434f-915b-38865b0e6001 service nova] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7f2a0895-fcf3-46f7-b84e-db486fd6a8e9 req-df047faa-519e-434f-915b-38865b0e6001 service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-7f2a0895-fcf3-46f7-b84e-db486fd6a8e9 req-df047faa-519e-434f-915b-38865b0e6001 service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:14 user nova-compute[72793]: DEBUG nova.compute.manager [req-7f2a0895-fcf3-46f7-b84e-db486fd6a8e9 req-df047faa-519e-434f-915b-38865b0e6001 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] No waiting events found dispatching network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:49:14 user nova-compute[72793]: WARNING nova.compute.manager [req-7f2a0895-fcf3-46f7-b84e-db486fd6a8e9 req-df047faa-519e-434f-915b-38865b0e6001 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received unexpected event network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 for instance with vm_state building and task_state spawning.
Aug 17 04:49:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247756.8088558, 62d54f11-b0da-41f6-a29a-8c6f221a9b57 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:49:16 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] VM Resumed (Lifecycle Event)
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:49:16 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Instance spawned successfully.
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:49:16 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692247756.809136, 62d54f11-b0da-41f6-a29a-8c6f221a9b57 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:49:16 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] VM Started (Lifecycle Event)
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:49:16 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:49:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a9508cd-8d9a-4d37-bb72-db7893166d04 req-2ad9a029-cf98-4703-ab48-df0a5e4fc8fd service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:49:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a9508cd-8d9a-4d37-bb72-db7893166d04 req-2ad9a029-cf98-4703-ab48-df0a5e4fc8fd service nova] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a9508cd-8d9a-4d37-bb72-db7893166d04 req-2ad9a029-cf98-4703-ab48-df0a5e4fc8fd service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-0a9508cd-8d9a-4d37-bb72-db7893166d04 req-2ad9a029-cf98-4703-ab48-df0a5e4fc8fd service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:17 user nova-compute[72793]: DEBUG nova.compute.manager [req-0a9508cd-8d9a-4d37-bb72-db7893166d04 req-2ad9a029-cf98-4703-ab48-df0a5e4fc8fd service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] No waiting events found dispatching network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:49:17 user nova-compute[72793]: WARNING nova.compute.manager [req-0a9508cd-8d9a-4d37-bb72-db7893166d04 req-2ad9a029-cf98-4703-ab48-df0a5e4fc8fd service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received unexpected event network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 for instance with vm_state building and task_state spawning.
Aug 17 04:49:17 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:49:17 user nova-compute[72793]: INFO nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 17 04:49:17 user nova-compute[72793]: DEBUG nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:49:17 user nova-compute[72793]: INFO nova.compute.manager [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Took 16.20 seconds to build instance.
Aug 17 04:49:17 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a576b6c9-b1d4-4934-a68b-91a4995cf623 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.287s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:18 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:49:18 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:49:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:49:40 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:49:40 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:49:40 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=25.30941390991211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:49:40 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 36b02bd4-6359-4c6c-b7d1-b9458ff02348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62d54f11-b0da-41f6-a29a-8c6f221a9b57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:49:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:49:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:49:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 36b02bd4-6359-4c6c-b7d1-b9458ff02348 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:49:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:49:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:49:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:50:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:50:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:50:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:50:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:50:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:50:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:50:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:50:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.30876922607422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 36b02bd4-6359-4c6c-b7d1-b9458ff02348 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 62d54f11-b0da-41f6-a29a-8c6f221a9b57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:50:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:45 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:49 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:50:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-changed-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG nova.compute.manager [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Refreshing instance network info cache due to event network-changed-a7d38b0d-c307-4de0-956b-d8f6ab2422c5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] Acquiring lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] Acquired lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG nova.network.neutron [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Refreshing network info cache for port a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updated VIF entry in instance network info cache for port a7d38b0d-c307-4de0-956b-d8f6ab2422c5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating instance_info_cache with network_info: [{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4ae26cbe-40a9-4575-b7d4-e50b3fe4e13a req-8841a53e-66d8-47af-adfd-1d9f8ce42421 service nova] Releasing lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-changed-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.compute.manager [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Refreshing instance network info cache due to event network-changed-a7d38b0d-c307-4de0-956b-d8f6ab2422c5. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] Acquiring lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:53 user nova-compute[72793]: INFO nova.compute.manager [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Terminating instance
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating instance_info_cache with network_info: [{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] Acquired lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG nova.network.neutron [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Refreshing network info cache for port a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:54 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Instance destroyed successfully.
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'resources' on Instance uuid 62d54f11-b0da-41f6-a29a-8c6f221a9b57 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-703646000',display_name='tempest-TestVolumeBootPattern-server-703646000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-703646000',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-whi7elka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:49:17Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=62d54f11-b0da-41f6-a29a-8c6f221a9b57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_vif [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7d38b0d-c3, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:50:54 user nova-compute[72793]: INFO os_vif [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:45:73,bridge_name='br-int',has_traffic_filtering=True,id=a7d38b0d-c307-4de0-956b-d8f6ab2422c5,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7d38b0d-c3')
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DverxnNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:50:54 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f77e5e-a0be-497e-a7a7-e6cb99b7e706]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8892d13-c66f-40a7-8693-dd238012a652]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:50:54 user nova-compute[72793]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd (non-flash)
Aug 17 04:50:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:50:54 user nova-compute[72793]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd (non-flash)
Aug 17 04:50:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acfe6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd'): ({'sdc'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Removing single pathed devices sdc {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c445dd2e-edbc-464a-bd32-9fdb063ea35f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba884b5-0cf3-49e3-b070-baaab364ba7e]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flushing IO for device /dev/sdc {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1598e625-fc4b-4974-bf00-305f38c1007b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-b9918bc4-97a1-48c3-ac1e-ffdc730acfef req-ac00399a-9a35-4e18-9262-c0bcfdd9bc06 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-vif-unplugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b9918bc4-97a1-48c3-ac1e-ffdc730acfef req-ac00399a-9a35-4e18-9262-c0bcfdd9bc06 service nova] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b9918bc4-97a1-48c3-ac1e-ffdc730acfef req-ac00399a-9a35-4e18-9262-c0bcfdd9bc06 service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b9918bc4-97a1-48c3-ac1e-ffdc730acfef req-ac00399a-9a35-4e18-9262-c0bcfdd9bc06 service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-b9918bc4-97a1-48c3-ac1e-ffdc730acfef req-ac00399a-9a35-4e18-9262-c0bcfdd9bc06 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] No waiting events found dispatching network-vif-unplugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.compute.manager [req-b9918bc4-97a1-48c3-ac1e-ffdc730acfef req-ac00399a-9a35-4e18-9262-c0bcfdd9bc06 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-vif-unplugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d019ecf-fd1e-4cc2-bfbb-8e12ce6589de]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] SCSI volumes sdc have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23135633535376639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1bad44d', '/dev/disk/by-id/scsi-1SCST_BIO1bad44d-15c557f95bc470eb') {{(pid=84011) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e75262-d0fd-43b7-bd40-d0a07c7bbbc8]: (4, None) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[317f4681-df4c-427f-9f0d-472d82a3a59a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce83663-5710-4a5e-94e3-c4e9f216b9dc]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260]
Aug 17 04:50:54 user nova-compute[72793]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd, portal: 172.16.0.220,3260] successful.
Aug 17 04:50:54 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aff2ff00-39c2-44d7-9e5a-bbd9d4208bcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[47749ee9-7b01-4a81-9d6e-bf9da639dd8b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== disconnect_volume: return (333ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:50:54 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Deleting instance files /opt/stack/data/nova/instances/62d54f11-b0da-41f6-a29a-8c6f221a9b57_del
Aug 17 04:50:54 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Deletion of /opt/stack/data/nova/instances/62d54f11-b0da-41f6-a29a-8c6f221a9b57_del complete
Aug 17 04:50:54 user nova-compute[72793]: INFO nova.compute.manager [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updated VIF entry in instance network info cache for port a7d38b0d-c307-4de0-956b-d8f6ab2422c5. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG nova.network.neutron [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating instance_info_cache with network_info: [{"id": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "address": "fa:16:3e:13:45:73", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7d38b0d-c3", "ovs_interfaceid": "a7d38b0d-c307-4de0-956b-d8f6ab2422c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-397b2146-8563-4b37-9f60-dc5fde0de70c req-f78ff488-ad9c-49e7-8ee7-c2613490c6c4 service nova] Releasing lock "refresh_cache-62d54f11-b0da-41f6-a29a-8c6f221a9b57" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:55 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:50:55 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Took 0.50 seconds to deallocate network for instance.
Aug 17 04:50:55 user nova-compute[72793]: DEBUG nova.compute.manager [req-2a8754ce-4c6c-4095-a4b6-c5a26fc3b24c req-af6ae996-5035-475f-a0cb-8be8443fa978 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-vif-deleted-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:50:56 user nova-compute[72793]: INFO nova.compute.manager [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Took 0.82 seconds to detach 1 volumes for instance.
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:56 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Deleted allocations for instance 62d54f11-b0da-41f6-a29a-8c6f221a9b57
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-149fcf55-4e54-421c-b3c9-ac045de3d03d tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.926s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-55e893d2-ac23-438b-81ec-f6ab0d1c9b78 req-17dd9deb-2c91-473f-ad57-82231beb2e93 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received event network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-55e893d2-ac23-438b-81ec-f6ab0d1c9b78 req-17dd9deb-2c91-473f-ad57-82231beb2e93 service nova] Acquiring lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-55e893d2-ac23-438b-81ec-f6ab0d1c9b78 req-17dd9deb-2c91-473f-ad57-82231beb2e93 service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-55e893d2-ac23-438b-81ec-f6ab0d1c9b78 req-17dd9deb-2c91-473f-ad57-82231beb2e93 service nova] Lock "62d54f11-b0da-41f6-a29a-8c6f221a9b57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:50:56 user nova-compute[72793]: DEBUG nova.compute.manager [req-55e893d2-ac23-438b-81ec-f6ab0d1c9b78 req-17dd9deb-2c91-473f-ad57-82231beb2e93 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] No waiting events found dispatching network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:50:56 user nova-compute[72793]: WARNING nova.compute.manager [req-55e893d2-ac23-438b-81ec-f6ab0d1c9b78 req-17dd9deb-2c91-473f-ad57-82231beb2e93 service nova] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Received unexpected event network-vif-plugged-a7d38b0d-c307-4de0-956b-d8f6ab2422c5 for instance with vm_state deleted and task_state None.
Aug 17 04:50:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:50:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247854.4512646, 62d54f11-b0da-41f6-a29a-8c6f221a9b57 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:51:09 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] VM Stopped (Lifecycle Event)
Aug 17 04:51:09 user nova-compute[72793]: DEBUG nova.compute.manager [None req-99bb1035-f2f4-407f-8bed-1bf07e514b63 None None] [instance: 62d54f11-b0da-41f6-a29a-8c6f221a9b57] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:51:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:51:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:51:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:51:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:51:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:51:41 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.307884216308594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 36b02bd4-6359-4c6c-b7d1-b9458ff02348 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:51:41 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:51:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:51:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:51:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 36b02bd4-6359-4c6c-b7d1-b9458ff02348 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-changed-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG nova.compute.manager [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Refreshing instance network info cache due to event network-changed-11fd3130-8b74-4d37-8048-a7fdbee319f3. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] Acquiring lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] Acquired lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG nova.network.neutron [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Refreshing network info cache for port 11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:51:57 user nova-compute[72793]: INFO nova.compute.manager [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Terminating instance
Aug 17 04:51:57 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-989110a4-7561-4e20-9754-cd0334fb6340 req-122ea058-a3f6-4f20-a82f-227140ca3eec service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-vif-unplugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-989110a4-7561-4e20-9754-cd0334fb6340 req-122ea058-a3f6-4f20-a82f-227140ca3eec service nova] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-989110a4-7561-4e20-9754-cd0334fb6340 req-122ea058-a3f6-4f20-a82f-227140ca3eec service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-989110a4-7561-4e20-9754-cd0334fb6340 req-122ea058-a3f6-4f20-a82f-227140ca3eec service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-989110a4-7561-4e20-9754-cd0334fb6340 req-122ea058-a3f6-4f20-a82f-227140ca3eec service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] No waiting events found dispatching network-vif-unplugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.compute.manager [req-989110a4-7561-4e20-9754-cd0334fb6340 req-122ea058-a3f6-4f20-a82f-227140ca3eec service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-vif-unplugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.network.neutron [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updated VIF entry in instance network info cache for port 11fd3130-8b74-4d37-8048-a7fdbee319f3. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.network.neutron [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [{"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-4a47409b-2ba2-4c57-86f2-662eecbab1ea req-e9753062-1493-44f9-9a9e-c5eb2687fb30 service nova] Releasing lock "refresh_cache-36b02bd4-6359-4c6c-b7d1-b9458ff02348" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:51:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Instance destroyed successfully.
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lazy-loading 'resources' on Instance uuid 36b02bd4-6359-4c6c-b7d1-b9458ff02348 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1031714815',display_name='tempest-TestVolumeBootPattern-server-1031714815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1031714815',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Dn3FGorXgibrOtKd/h9pj1E3G4mq7Xaj8WEddD8dNcrmpVYLy4bBz7I9W+J+DA47csqyFXTBXFX8+MGUQ19k0QGkOQHG/S3BEltS/skvvxDVV+tf1/WIWaFcQ40iHnA==',key_name='tempest-TestVolumeBootPattern-930228666',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:47:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6d3627ce05643749885c08563fbe747',ramdisk_id='',reservation_id='r-rihedbb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2127448763',owner_user_name='tempest-TestVolumeBootPattern-2127448763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:47:11Z,user_data=None,user_id='a0ac4e1570914524a592a7a67453bcc3',uuid=36b02bd4-6359-4c6c-b7d1-b9458ff02348,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converting VIF {"id": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "address": "fa:16:3e:26:da:eb", "network": {"id": "bdb5cf34-fbae-448a-86a0-0e5532289702", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1756741153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6d3627ce05643749885c08563fbe747", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11fd3130-8b", "ovs_interfaceid": "11fd3130-8b74-4d37-8048-a7fdbee319f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_vif [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11fd3130-8b, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:51:58 user nova-compute[72793]: INFO os_vif [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=11fd3130-8b74-4d37-8048-a7fdbee319f3,network=Network(bdb5cf34-fbae-448a-86a0-0e5532289702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11fd3130-8b')
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwAWbdXF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:51:58 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae13fe3d-c967-400a-8e63-a1015ae0a371]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e63cb2-cf42-4e3f-8f3b-3d4afaea8800]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:51:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b (non-flash)
Aug 17 04:51:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acfe4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6c3c35-92cf-4a7e-a222-4291936c49af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e434e2c-23f4-4938-a730-f1bde3b6239f]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[099d8551-8c0e-497d-a3d4-8b94d88d080b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0316ffa0-98ae-4e52-be53-1571b1ee3d03]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23930643134323239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4f4c4313', '/dev/disk/by-id/scsi-1SCST_BIO4f4c4313-90d1422962995a25') {{(pid=84011) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab92873-2d0a-43b0-8641-5d9645c5ac1f]: (4, None) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[05414f9c-5ee4-4360-8530-3933b945a6a8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3962ad-6e2a-445b-9801-71ea4ee38e7b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260]
Aug 17 04:51:58 user nova-compute[72793]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b, portal: 172.16.0.220,3260] successful.
Aug 17 04:51:58 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bf3a5a0-b7ab-4111-bdbd-ae7175a9182b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c775bc7-ea1b-43ad-9cba-170ad7663d36]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] <== disconnect_volume: return (277ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:51:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Deleting instance files /opt/stack/data/nova/instances/36b02bd4-6359-4c6c-b7d1-b9458ff02348_del
Aug 17 04:51:58 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Deletion of /opt/stack/data/nova/instances/36b02bd4-6359-4c6c-b7d1-b9458ff02348_del complete
Aug 17 04:51:58 user nova-compute[72793]: INFO nova.compute.manager [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 04:51:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:51:59 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:51:59 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Took 0.45 seconds to deallocate network for instance.
Aug 17 04:51:59 user nova-compute[72793]: DEBUG nova.compute.manager [req-515d4404-04f7-411c-9e5b-5f91bbdda93f req-e35ff300-7a27-4634-ae5b-fdb834155ec3 service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-vif-deleted-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-c1609603-1b75-47c7-9112-224a60949db9 req-66391dea-1e40-4f19-911c-4e1ad0a1cbfd service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received event network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c1609603-1b75-47c7-9112-224a60949db9 req-66391dea-1e40-4f19-911c-4e1ad0a1cbfd service nova] Acquiring lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c1609603-1b75-47c7-9112-224a60949db9 req-66391dea-1e40-4f19-911c-4e1ad0a1cbfd service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-c1609603-1b75-47c7-9112-224a60949db9 req-66391dea-1e40-4f19-911c-4e1ad0a1cbfd service nova] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG nova.compute.manager [req-c1609603-1b75-47c7-9112-224a60949db9 req-66391dea-1e40-4f19-911c-4e1ad0a1cbfd service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] No waiting events found dispatching network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:52:00 user nova-compute[72793]: WARNING nova.compute.manager [req-c1609603-1b75-47c7-9112-224a60949db9 req-66391dea-1e40-4f19-911c-4e1ad0a1cbfd service nova] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Received unexpected event network-vif-plugged-11fd3130-8b74-4d37-8048-a7fdbee319f3 for instance with vm_state active and task_state deleting.
Aug 17 04:52:00 user nova-compute[72793]: INFO nova.compute.manager [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Took 0.87 seconds to detach 1 volumes for instance.
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:52:00 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Deleted allocations for instance 36b02bd4-6359-4c6c-b7d1-b9458ff02348
Aug 17 04:52:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b9ec0a55-952a-411e-9608-98d0c3243db1 tempest-TestVolumeBootPattern-2127448763 tempest-TestVolumeBootPattern-2127448763-project-member] Lock "36b02bd4-6359-4c6c-b7d1-b9458ff02348" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.754s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:52:02 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:52:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692247918.4446485, 36b02bd4-6359-4c6c-b7d1-b9458ff02348 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:52:13 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] VM Stopped (Lifecycle Event)
Aug 17 04:52:13 user nova-compute[72793]: DEBUG nova.compute.manager [None req-b2a60815-2b6d-4310-8d4b-8749c1e67e59 None None] [instance: 36b02bd4-6359-4c6c-b7d1-b9458ff02348] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:52:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:28 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:33 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:38 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:42 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:52:43 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:52:43 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.30693817138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:52:43 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:52:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:48 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:52:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:52:53 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:52:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:52:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 04:52:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:52:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:58 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:52:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:08 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:13 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:18 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Starting instance... {{(pid=72793) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:21 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72793) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 04:53:21 user nova-compute[72793]: INFO nova.compute.claims [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Claim successful on node user
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Start building networks asynchronously for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Allocating IP information in the background. {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] allocate_for_instance() {{(pid=72793) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 04:53:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Start building block device mappings for instance. {{(pid=72793) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.policy [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9b201bc7a6b436f99d36cedf7a005ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9456cf99514b7d9f715761450b762a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72793) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Start spawning the instance on the hypervisor. {{(pid=72793) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Creating instance directory {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 04:53:22 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Creating image(s)
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "/opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "/opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "/opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.253s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk 1073741824 {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d,backing_fmt=raw /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk 1073741824" returned: 0 in 0.055s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "3df7d9af4f394f5236ffd9fec8b98b6b6d61265d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:22 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Successfully created port: 9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3df7d9af4f394f5236ffd9fec8b98b6b6d61265d --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Checking if we can resize image /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk. size=1073741824 {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.virt.disk.api [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Cannot resize image /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk to a smaller size. {{(pid=72793) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'migration_context' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Created local disks {{(pid=72793) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Ensure instance console log exists: /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/console.log {{(pid=72793) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Successfully updated port: 9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Building network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-changed-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.compute.manager [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Refreshing instance network info cache due to event network-changed-9fa758cb-f75d-4f90-bfde-854a6a7af853. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:53:23 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Instance cache missing network info. {{(pid=72793) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.neutron [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Instance network_info: |[{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72793) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.neutron [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Refreshing network info cache for port 9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Start _get_guest_xml network_info=[{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'image_id': '5f4b4804-03ee-46d6-a29f-d5a8a50dfc98'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 04:53:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:53:24 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CPU controller missing on host. {{(pid=72793) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.host [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CPU controller found on host. {{(pid=72793) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72793) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T03:53:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T03:53:24Z,direct_url=<?>,disk_format='qcow2',id=5f4b4804-03ee-46d6-a29f-d5a8a50dfc98,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1cc711b057f64d01a027be757f962556',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T03:53:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Flavor limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Image limits 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Flavor pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Image pref 0:0:0 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Got 1 possible topologies {{(pid=72793) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.hardware [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72793) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-815090929',display_name='tempest-SnapshotDataIntegrityTests-server-815090929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-815090929',id=52,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/gAawtZz4la5sEhIHILDV32mJWur41ijqQmIBqcPgMTLlqZMBR0wvSBnDnMcbzJVuYkNJN5SZE0okd6BpLtuE+CHzFEBSNJhahb0qTAtHJo0NnBMFbP3sxlH9OP3AyDQ==',key_name='tempest-keypair-97245253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9456cf99514b7d9f715761450b762a',ramdisk_id='',reservation_id='r-08i3cyxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1804511815',owner_user_name='tempest-SnapshotDataIntegrityTests-1804511815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9b201bc7a6b436f99d36cedf7a005ef',uuid=950b92dd-08ba-47bf-bf9b-31213692e546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72793) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Converting VIF {"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.objects.instance [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'pci_devices' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] End _get_guest_xml xml=<domain type="kvm">
Aug 17 04:53:24 user nova-compute[72793]:   <uuid>950b92dd-08ba-47bf-bf9b-31213692e546</uuid>
Aug 17 04:53:24 user nova-compute[72793]:   <name>instance-00000034</name>
Aug 17 04:53:24 user nova-compute[72793]:   <memory>524288</memory>
Aug 17 04:53:24 user nova-compute[72793]:   <vcpu>1</vcpu>
Aug 17 04:53:24 user nova-compute[72793]:   <metadata>
Aug 17 04:53:24 user nova-compute[72793]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 04:53:24 user nova-compute[72793]:       <nova:package version="0.0.0"/>
Aug 17 04:53:24 user nova-compute[72793]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-815090929</nova:name>
Aug 17 04:53:24 user nova-compute[72793]:       <nova:creationTime>2023-08-17 04:53:24</nova:creationTime>
Aug 17 04:53:24 user nova-compute[72793]:       <nova:flavor name="m1.tiny">
Aug 17 04:53:24 user nova-compute[72793]:         <nova:memory>512</nova:memory>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:disk>1</nova:disk>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:swap>0</nova:swap>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:vcpus>1</nova:vcpus>
Aug 17 04:53:24 user nova-compute[72793]:       </nova:flavor>
Aug 17 04:53:24 user nova-compute[72793]:       <nova:owner>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:user uuid="e9b201bc7a6b436f99d36cedf7a005ef">tempest-SnapshotDataIntegrityTests-1804511815-project-member</nova:user>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:project uuid="bc9456cf99514b7d9f715761450b762a">tempest-SnapshotDataIntegrityTests-1804511815</nova:project>
Aug 17 04:53:24 user nova-compute[72793]:       </nova:owner>
Aug 17 04:53:24 user nova-compute[72793]:       <nova:root type="image" uuid="5f4b4804-03ee-46d6-a29f-d5a8a50dfc98"/>
Aug 17 04:53:24 user nova-compute[72793]:       <nova:ports>
Aug 17 04:53:24 user nova-compute[72793]:         <nova:port uuid="9fa758cb-f75d-4f90-bfde-854a6a7af853">
Aug 17 04:53:24 user nova-compute[72793]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 04:53:24 user nova-compute[72793]:         </nova:port>
Aug 17 04:53:24 user nova-compute[72793]:       </nova:ports>
Aug 17 04:53:24 user nova-compute[72793]:     </nova:instance>
Aug 17 04:53:24 user nova-compute[72793]:   </metadata>
Aug 17 04:53:24 user nova-compute[72793]:   <sysinfo type="smbios">
Aug 17 04:53:24 user nova-compute[72793]:     <system>
Aug 17 04:53:24 user nova-compute[72793]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 04:53:24 user nova-compute[72793]:       <entry name="product">OpenStack Nova</entry>
Aug 17 04:53:24 user nova-compute[72793]:       <entry name="version">0.0.0</entry>
Aug 17 04:53:24 user nova-compute[72793]:       <entry name="serial">950b92dd-08ba-47bf-bf9b-31213692e546</entry>
Aug 17 04:53:24 user nova-compute[72793]:       <entry name="uuid">950b92dd-08ba-47bf-bf9b-31213692e546</entry>
Aug 17 04:53:24 user nova-compute[72793]:       <entry name="family">Virtual Machine</entry>
Aug 17 04:53:24 user nova-compute[72793]:     </system>
Aug 17 04:53:24 user nova-compute[72793]:   </sysinfo>
Aug 17 04:53:24 user nova-compute[72793]:   <os>
Aug 17 04:53:24 user nova-compute[72793]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 04:53:24 user nova-compute[72793]:     <boot dev="hd"/>
Aug 17 04:53:24 user nova-compute[72793]:     <smbios mode="sysinfo"/>
Aug 17 04:53:24 user nova-compute[72793]:   </os>
Aug 17 04:53:24 user nova-compute[72793]:   <features>
Aug 17 04:53:24 user nova-compute[72793]:     <acpi/>
Aug 17 04:53:24 user nova-compute[72793]:     <apic/>
Aug 17 04:53:24 user nova-compute[72793]:     <vmcoreinfo/>
Aug 17 04:53:24 user nova-compute[72793]:   </features>
Aug 17 04:53:24 user nova-compute[72793]:   <clock offset="utc">
Aug 17 04:53:24 user nova-compute[72793]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 04:53:24 user nova-compute[72793]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 04:53:24 user nova-compute[72793]:     <timer name="hpet" present="no"/>
Aug 17 04:53:24 user nova-compute[72793]:   </clock>
Aug 17 04:53:24 user nova-compute[72793]:   <cpu mode="custom" match="exact">
Aug 17 04:53:24 user nova-compute[72793]:     <model>Nehalem</model>
Aug 17 04:53:24 user nova-compute[72793]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 04:53:24 user nova-compute[72793]:   </cpu>
Aug 17 04:53:24 user nova-compute[72793]:   <devices>
Aug 17 04:53:24 user nova-compute[72793]:     <disk type="file" device="disk">
Aug 17 04:53:24 user nova-compute[72793]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 04:53:24 user nova-compute[72793]:       <source file="/opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk"/>
Aug 17 04:53:24 user nova-compute[72793]:       <target dev="vda" bus="virtio"/>
Aug 17 04:53:24 user nova-compute[72793]:     </disk>
Aug 17 04:53:24 user nova-compute[72793]:     <interface type="ethernet">
Aug 17 04:53:24 user nova-compute[72793]:       <mac address="fa:16:3e:81:2c:ac"/>
Aug 17 04:53:24 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:53:24 user nova-compute[72793]:       <mtu size="1442"/>
Aug 17 04:53:24 user nova-compute[72793]:       <target dev="tap9fa758cb-f7"/>
Aug 17 04:53:24 user nova-compute[72793]:     </interface>
Aug 17 04:53:24 user nova-compute[72793]:     <serial type="pty">
Aug 17 04:53:24 user nova-compute[72793]:       <log file="/opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/console.log" append="off"/>
Aug 17 04:53:24 user nova-compute[72793]:     </serial>
Aug 17 04:53:24 user nova-compute[72793]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 04:53:24 user nova-compute[72793]:     <video>
Aug 17 04:53:24 user nova-compute[72793]:       <model type="virtio"/>
Aug 17 04:53:24 user nova-compute[72793]:     </video>
Aug 17 04:53:24 user nova-compute[72793]:     <rng model="virtio">
Aug 17 04:53:24 user nova-compute[72793]:       <backend model="random">/dev/urandom</backend>
Aug 17 04:53:24 user nova-compute[72793]:     </rng>
Aug 17 04:53:24 user nova-compute[72793]:     <controller type="usb" index="0" model="none"/>
Aug 17 04:53:24 user nova-compute[72793]:     <memballoon model="virtio">
Aug 17 04:53:24 user nova-compute[72793]:       <stats period="10"/>
Aug 17 04:53:24 user nova-compute[72793]:     </memballoon>
Aug 17 04:53:24 user nova-compute[72793]:   </devices>
Aug 17 04:53:24 user nova-compute[72793]: </domain>
Aug 17 04:53:24 user nova-compute[72793]:  {{(pid=72793) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-815090929',display_name='tempest-SnapshotDataIntegrityTests-server-815090929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-815090929',id=52,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/gAawtZz4la5sEhIHILDV32mJWur41ijqQmIBqcPgMTLlqZMBR0wvSBnDnMcbzJVuYkNJN5SZE0okd6BpLtuE+CHzFEBSNJhahb0qTAtHJo0NnBMFbP3sxlH9OP3AyDQ==',key_name='tempest-keypair-97245253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9456cf99514b7d9f715761450b762a',ramdisk_id='',reservation_id='r-08i3cyxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1804511815',owner_user_name='tempest-SnapshotDataIntegrityTests-1804511815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T04:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9b201bc7a6b436f99d36cedf7a005ef',uuid=950b92dd-08ba-47bf-bf9b-31213692e546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Converting VIF {"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG os_vif [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7') {{(pid=72793) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fa758cb-f7, may_exist=True, interface_attrs={}) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fa758cb-f7, col_values=(('external_ids', {'iface-id': '9fa758cb-f75d-4f90-bfde-854a6a7af853', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:2c:ac', 'vm-uuid': '950b92dd-08ba-47bf-bf9b-31213692e546'}),), if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:24 user nova-compute[72793]: INFO os_vif [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7')
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No VIF found with MAC fa:16:3e:81:2c:ac, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.neutron [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated VIF entry in instance network info cache for port 9fa758cb-f75d-4f90-bfde-854a6a7af853. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG nova.network.neutron [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:53:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-174466ee-07ee-4f99-9b01-121a17ec5bf7 req-2a272bb9-77b0-404b-b3e9-eca387fbab23 service nova] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2f6739d-6d15-406f-8576-1215840d1957 req-e37d0c33-0f9a-49cb-b49e-671330af1846 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2f6739d-6d15-406f-8576-1215840d1957 req-e37d0c33-0f9a-49cb-b49e-671330af1846 service nova] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2f6739d-6d15-406f-8576-1215840d1957 req-e37d0c33-0f9a-49cb-b49e-671330af1846 service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b2f6739d-6d15-406f-8576-1215840d1957 req-e37d0c33-0f9a-49cb-b49e-671330af1846 service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:25 user nova-compute[72793]: DEBUG nova.compute.manager [req-b2f6739d-6d15-406f-8576-1215840d1957 req-e37d0c33-0f9a-49cb-b49e-671330af1846 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] No waiting events found dispatching network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:53:25 user nova-compute[72793]: WARNING nova.compute.manager [req-b2f6739d-6d15-406f-8576-1215840d1957 req-e37d0c33-0f9a-49cb-b49e-671330af1846 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received unexpected event network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 for instance with vm_state building and task_state spawning.
Aug 17 04:53:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692248007.8273802, 950b92dd-08ba-47bf-bf9b-31213692e546 => Resumed> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:53:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] VM Resumed (Lifecycle Event)
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Instance event wait completed in 0 seconds for  {{(pid=72793) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Guest created on hypervisor {{(pid=72793) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 04:53:27 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Instance spawned successfully.
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Found default for hw_cdrom_bus of ide {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Found default for hw_disk_bus of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Found default for hw_input_bus of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Found default for hw_pointer_model of None {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Found default for hw_video_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Found default for hw_vif_model of virtio {{(pid=72793) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 04:53:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.virt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Emitting event <LifecycleEvent: 1692248007.8306928, 950b92dd-08ba-47bf-bf9b-31213692e546 => Started> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 04:53:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] VM Started (Lifecycle Event)
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72793) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 04:53:27 user nova-compute[72793]: INFO nova.compute.manager [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 04:53:27 user nova-compute[72793]: INFO nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 17 04:53:27 user nova-compute[72793]: DEBUG nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 04:53:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-b36592a0-dad9-4527-8ae4-18e0bbbc6410 req-a04f28f8-d66a-457c-bf9e-545184eb27cf service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:53:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b36592a0-dad9-4527-8ae4-18e0bbbc6410 req-a04f28f8-d66a-457c-bf9e-545184eb27cf service nova] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b36592a0-dad9-4527-8ae4-18e0bbbc6410 req-a04f28f8-d66a-457c-bf9e-545184eb27cf service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b36592a0-dad9-4527-8ae4-18e0bbbc6410 req-a04f28f8-d66a-457c-bf9e-545184eb27cf service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:28 user nova-compute[72793]: DEBUG nova.compute.manager [req-b36592a0-dad9-4527-8ae4-18e0bbbc6410 req-a04f28f8-d66a-457c-bf9e-545184eb27cf service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] No waiting events found dispatching network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 04:53:28 user nova-compute[72793]: WARNING nova.compute.manager [req-b36592a0-dad9-4527-8ae4-18e0bbbc6410 req-a04f28f8-d66a-457c-bf9e-545184eb27cf service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received unexpected event network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 for instance with vm_state building and task_state spawning.
Aug 17 04:53:28 user nova-compute[72793]: INFO nova.compute.manager [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Took 6.13 seconds to build instance.
Aug 17 04:53:28 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-ab5763b1-8001-49a4-b206-92519a614b6b tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.232s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:53:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:53:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:53:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:53:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:43 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:53:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:53:44 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:53:44 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=25.269580841064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:53:44 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:53:45 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:53:45 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:53:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:53:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:51 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:53:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:54 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:53:54 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:53:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:53:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:53:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:28 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:54:28 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:54:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:35 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_power_states {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:35 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Triggering sync for uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 04:54:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:54:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:54:35 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:54:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:44 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:54:45 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:54:45 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.267311096191406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:54:45 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:54:46 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:54:46 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:54:46 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:54:46 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:54:46 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:54:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:54:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:52 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:54:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:54:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:54:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:54:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:54:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:54:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:54:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:54:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:54:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:02 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:55:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:55:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:55:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:12 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-changed-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG nova.compute.manager [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Refreshing instance network info cache due to event network-changed-9fa758cb-f75d-4f90-bfde-854a6a7af853. {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Refreshing network info cache for port 9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated VIF entry in instance network info cache for port 9fa758cb-f75d-4f90-bfde-854a6a7af853. {{(pid=72793) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG nova.network.neutron [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:55:13 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-46d9bb7c-51e2-49a6-8161-63418c3d13bd req-4c78cfcf-919f-4b3e-8eab-a12634f395a1 service nova] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:55:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:55:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:55:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:55:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:16 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:55:18 user nova-compute[72793]: INFO nova.compute.manager [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attaching volume ae7390a5-690c-4cac-a13a-5d9b29af5e5e to /dev/vdb
Aug 17 04:55:18 user nova-compute[72793]: DEBUG os_brick.utils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6cbf0-bbf0-4dbb-a8ce-39f10f1ab2c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[958c632a-9101-41cd-a3cc-7e7a9c092ec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[af982359-39c5-40e2-9958-7e3902b9818d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b98c2-8b51-460e-a550-c356f6818108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:55:18 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:55:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61436722-9aa6-4d26-93c1-fae1b996a775]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG os_brick.utils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:55:18 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating existing volume attachment record: 9a493650-4595-4987-9d0e-e89b2514e238 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:55:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKawGohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:55:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:55:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:55:28 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7235c8c5-9814-4f9a-bd21-13ca953af496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:55:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d4991-1088-4678-b491-10987491dc5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e] added
Aug 17 04:55:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78bb072-7387-48a4-aa8d-1832db87e106]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112f705-6db4-4864-a4b5-c4d7e0d0aedf]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKawGohD {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKawGohD" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc009a2c-2c49-47fb-b5ba-2a80945bd88f]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKawGohD'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ad646-be77-4355-9d8a-0c0f3a1e4035]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a1122f-95b5-433a-862b-5d7373eb8af1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:55:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:55:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:55:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:55:28 user nova-compute[72793]: 
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd72a5-8f74-4286-8bbf-9c6869dad899]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260]
Aug 17 04:55:28 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260] successful.
Aug 17 04:55:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a27fdec-996c-49b0-8506-bba4f34f1a92]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd163c2-aa8d-4c16-9e9a-4164e3233052]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e (non-flash)
Aug 17 04:55:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e (non-flash)
Aug 17 04:55:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e95df-dc51-4522-bfc6-315754513f6b]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:55:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKawGohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '26264303665663134', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264303665663134', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:55:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:55:29 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:55:29 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:55:29 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:55:29 user nova-compute[72793]:   <serial>ae7390a5-690c-4cac-a13a-5d9b29af5e5e</serial>
Aug 17 04:55:29 user nova-compute[72793]: </disk>
Aug 17 04:55:29 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:55:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:55:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:55:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No VIF found with MAC fa:16:3e:81:2c:ac, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:55:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e831e822-88a3-4d32-aef1-b3e58fe1acbd tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.801s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:55:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:41 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72793) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:46 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:55:46 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:55:46 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.266094207763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:55:46 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:55:47 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:55:47 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:55:47 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:55:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:55:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:51 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:53 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:55:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:55:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:55:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:55:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:55:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:55:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:55:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:56:00 user nova-compute[72793]: INFO nova.compute.manager [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Detaching volume ae7390a5-690c-4cac-a13a-5d9b29af5e5e
Aug 17 04:56:00 user nova-compute[72793]: INFO nova.virt.block_device [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attempting to driver detach volume ae7390a5-690c-4cac-a13a-5d9b29af5e5e from mountpoint /dev/vdb
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Attempting to detach device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:56:00 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:56:00 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:56:00 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:56:00 user nova-compute[72793]:   <serial>ae7390a5-690c-4cac-a13a-5d9b29af5e5e</serial>
Aug 17 04:56:00 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:56:00 user nova-compute[72793]: </disk>
Aug 17 04:56:00 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:56:00 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config.
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:56:00 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:56:00 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:56:00 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:56:00 user nova-compute[72793]:   <serial>ae7390a5-690c-4cac-a13a-5d9b29af5e5e</serial>
Aug 17 04:56:00 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:56:00 user nova-compute[72793]: </disk>
Aug 17 04:56:00 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692248160.8687146, 950b92dd-08ba-47bf-bf9b-31213692e546 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:56:00 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config.
Aug 17 04:56:00 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKawGohD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:56:00 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[475177bf-2384-4224-ad35-a56dbc715bd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e732ea8-c926-460f-9f61-8dd5a7df2c5e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e (non-flash)
Aug 17 04:56:00 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e (non-flash)
Aug 17 04:56:00 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acfe6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[433064e7-e62a-4167-8d3a-76b6bf2a5ecb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a656bdd3-c665-4f4c-8575-6682126b8f09]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea3303b-217a-4cb3-9eb6-9deb82d79f9c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:56:00 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d411e5c4-ca88-4587-a0cc-b20c3e186553]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3ef28-34b3-4fd9-8c24-5f256a3d395a]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f56d20-c598-471e-a5b7-13472b476b5c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260]
Aug 17 04:56:01 user nova-compute[72793]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e, portal: 172.16.0.220,3260] successful.
Aug 17 04:56:01 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae7390a5-690c-4cac-a13a-5d9b29af5e5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d390c53f-0740-4743-91b9-4e5c8e7841b8]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== disconnect_volume: return (251ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:56:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fa5269b0-c60e-4c0a-8b77-4b0484cc57f5 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.598s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:56:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:46 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:47 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:56:47 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:56:47 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.26523208618164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:56:47 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:56:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:56:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:53 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG nova.objects.instance [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:56:54 user nova-compute[72793]: INFO nova.compute.manager [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attaching volume 42642673-a044-42ca-b028-6d7b8c55436e to /dev/vdb
Aug 17 04:56:54 user nova-compute[72793]: DEBUG os_brick.utils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb57fa-2550-4cd6-a0de-1788011cd3a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aedff8-60e2-464e-bf30-0bcb806a6a6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb904e-2066-4ed2-90af-ab73bfdad400]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[52637fee-86ad-4afc-b440-4c0e3ee4527e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:56:54 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:56:54 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[68937b73-ee8b-44a9-92cc-ef0c3f4ddf5b]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG os_brick.utils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:56:54 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating existing volume attachment record: 3cb84a94-43ba-4f18-835d-09393dc79a40 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:56:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:56:56 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:56:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:56:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtifnyVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:57:04 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:57:04 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:57:04 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe072a-b986-492a-875d-dfcb527c5ae2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:57:04 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[552aac16-d005-443d-b534-355f2d3e435e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e] added
Aug 17 04:57:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d42eb5e-989a-465d-95d5-aa9373603759]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[70604829-6f60-48d4-8a75-60f124672321]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtifnyVl {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtifnyVl" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8646d4-7301-4021-b381-53a137bfc32c]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtifnyVl'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beb2813-ed33-47a8-98f5-9599a7e1e4a4]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6920fdc-d0ca-49c9-ac44-96ee8ee52781]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:57:04 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:57:04 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:57:04 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:57:04 user nova-compute[72793]: 
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a723c-3c2a-4d9f-bf57-fe067dea0ba8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260]
Aug 17 04:57:04 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260] successful.
Aug 17 04:57:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38cd22c-41e3-4800-a132-9310eea46512]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da15c9-0985-4fab-8591-285100364038]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e (non-flash)
Aug 17 04:57:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e (non-flash)
Aug 17 04:57:04 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:05 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:05 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eae9aa-5d00-4a3f-9d9a-7984eb7ea1b5]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:05 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtifnyVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23164343965393135', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164343965393135', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG nova.objects.instance [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:57:06 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:57:06 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:57:06 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:57:06 user nova-compute[72793]:   <serial>42642673-a044-42ca-b028-6d7b8c55436e</serial>
Aug 17 04:57:06 user nova-compute[72793]: </disk>
Aug 17 04:57:06 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No VIF found with MAC fa:16:3e:81:2c:ac, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:57:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-328f8ab9-9a85-49e4-a709-44e2e3ccfe8d tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.855s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:57:09 user nova-compute[72793]: INFO nova.compute.manager [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Detaching volume 42642673-a044-42ca-b028-6d7b8c55436e
Aug 17 04:57:09 user nova-compute[72793]: INFO nova.virt.block_device [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attempting to driver detach volume 42642673-a044-42ca-b028-6d7b8c55436e from mountpoint /dev/vdb
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Attempting to detach device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:57:09 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:57:09 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:57:09 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:57:09 user nova-compute[72793]:   <serial>42642673-a044-42ca-b028-6d7b8c55436e</serial>
Aug 17 04:57:09 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:57:09 user nova-compute[72793]: </disk>
Aug 17 04:57:09 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:57:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config.
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:57:09 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:57:09 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:57:09 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:57:09 user nova-compute[72793]:   <serial>42642673-a044-42ca-b028-6d7b8c55436e</serial>
Aug 17 04:57:09 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:57:09 user nova-compute[72793]: </disk>
Aug 17 04:57:09 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692248229.7962546, 950b92dd-08ba-47bf-bf9b-31213692e546 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:57:09 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config.
Aug 17 04:57:09 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtifnyVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:57:09 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[df36dbd4-d8c1-4926-9253-555c62ae7ce4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b17506a-81e8-43a5-9e68-c4c358bbdb60]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e (non-flash)
Aug 17 04:57:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e (non-flash)
Aug 17 04:57:09 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98d0139bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b88456d-2d1c-4110-9546-6e9290c5270a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ec163-c8de-418a-a58e-038a7345db6c]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e69480-6580-4e69-87d9-340b3a052729]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2e0356-3256-43c5-9f7e-8ad5dce05ca6]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce862c84-4f02-4f77-af41-0e75d5593f16]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:09 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c11ff86-c738-4eeb-8fc4-78c27432eaf1]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260]
Aug 17 04:57:10 user nova-compute[72793]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e, portal: 172.16.0.220,3260] successful.
Aug 17 04:57:10 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42642673-a044-42ca-b028-6d7b8c55436e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a40eec9-9238-4c28-90e9-7121c3092fa1]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== disconnect_volume: return (271ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG nova.objects.instance [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:57:10 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-b8888513-c9f7-48e0-80b4-98e79bcf3bc1 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:57:11 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:47 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:57:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:57:48 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:57:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8793MB free_disk=25.264183044433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:57:48 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:57:49 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:57:49 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:57:49 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:57:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:57:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:57:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:56 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:57:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:57:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:57:58 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:57:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:58:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:58:03 user nova-compute[72793]: INFO nova.compute.manager [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attaching volume 89d16eee-7c20-4cf0-9c3b-9861c5c9825b to /dev/vdb
Aug 17 04:58:03 user nova-compute[72793]: DEBUG os_brick.utils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3177e9b7-55b4-4a06-93b0-95ec8393b405]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f939c5af-3e9c-42de-b0f1-6a5080b84ba4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[783dcdc6-7b3c-4a93-a8cb-3c35a9aa89a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f852e0-b6ea-43be-8e6e-3648dd28df4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:58:03 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:58:03 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebac0ace-7eba-4114-8680-dbaf86fd4e92]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG os_brick.utils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:58:03 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating existing volume attachment record: d6d7b31f-dd1b-4a5a-ab5b-0c9f7b2d3546 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:58:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMNwdCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:58:20 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:58:20 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:58:20 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc432796-7f53-4fd9-8b9a-11c107268ee8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:58:20 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d083c05f-5416-4ee7-a46d-ca06bc55103d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b] added
Aug 17 04:58:20 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5f5d01-3f9c-4e27-814d-24681784c469]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565b129-a6c4-4f55-8cb7-11e3dce7d064]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrMNwdCu {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrMNwdCu" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae58607-2f1d-4206-8a35-75209ba6605d]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrMNwdCu'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca9ccc-e978-4812-8b7c-e641b680c1a6]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[341473d1-dfca-4317-b435-3d78991e407f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:58:20 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:58:20 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:58:20 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:58:20 user nova-compute[72793]: 
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[74869f15-b0f2-48cb-a12b-4ca0a83cbd67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260]
Aug 17 04:58:20 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260] successful.
Aug 17 04:58:20 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0635e-a1fc-4330-9131-a93792a67ec3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2669de6d-dfca-4b58-bef4-583f2f863f32]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b (non-flash)
Aug 17 04:58:20 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b (non-flash)
Aug 17 04:58:20 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda26df-504d-455e-9891-cc21bfc709f5]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:20 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMNwdCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23339396136313332', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339396136313332', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG nova.objects.instance [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:58:21 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:58:21 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:58:21 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:58:21 user nova-compute[72793]:   <serial>89d16eee-7c20-4cf0-9c3b-9861c5c9825b</serial>
Aug 17 04:58:21 user nova-compute[72793]: </disk>
Aug 17 04:58:21 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No VIF found with MAC fa:16:3e:81:2c:ac, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:58:21 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-fb3e70b9-ec6a-442d-948e-9c02acc8dd59 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.495s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:58:24 user nova-compute[72793]: INFO nova.compute.manager [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Detaching volume 89d16eee-7c20-4cf0-9c3b-9861c5c9825b
Aug 17 04:58:24 user nova-compute[72793]: INFO nova.virt.block_device [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attempting to driver detach volume 89d16eee-7c20-4cf0-9c3b-9861c5c9825b from mountpoint /dev/vdb
Aug 17 04:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Attempting to detach device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:58:24 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:58:24 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:58:24 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:58:24 user nova-compute[72793]:   <serial>89d16eee-7c20-4cf0-9c3b-9861c5c9825b</serial>
Aug 17 04:58:24 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:58:24 user nova-compute[72793]: </disk>
Aug 17 04:58:24 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:58:24 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config.
Aug 17 04:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:58:24 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:58:24 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:58:24 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:58:24 user nova-compute[72793]:   <serial>89d16eee-7c20-4cf0-9c3b-9861c5c9825b</serial>
Aug 17 04:58:24 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:58:24 user nova-compute[72793]: </disk>
Aug 17 04:58:24 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692248304.9989772, 950b92dd-08ba-47bf-bf9b-31213692e546 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:58:25 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config.
Aug 17 04:58:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrMNwdCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:58:25 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[362576b7-8602-42eb-bf4b-c1d076299bed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc8170-c03d-401f-8246-ae5c2d7e710c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b (non-flash)
Aug 17 04:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b (non-flash)
Aug 17 04:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98f02f15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce46556-0bbe-442a-9cf3-e396ba43e0a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2a680-a789-49fc-87f5-46d334793d6a]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[59992351-d8f4-4562-ad85-444d95cf0113]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c945897-3f00-464a-beb9-d5657b62b917]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b006c950-a8dd-4301-a401-79e60be2638b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[987d03e0-1c79-40ef-b5a7-1fdbfc832dd3]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260]
Aug 17 04:58:25 user nova-compute[72793]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b, portal: 172.16.0.220,3260] successful.
Aug 17 04:58:25 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89d16eee-7c20-4cf0-9c3b-9861c5c9825b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76b77b1-e84e-4d0b-a1f2-90093e538001]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== disconnect_volume: return (252ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:58:25 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:58:26 user nova-compute[72793]: DEBUG nova.objects.instance [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:58:26 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-e53a4bb8-de03-48b2-ab43-094efadbab0f tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:58:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:48 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:49 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:58:49 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:58:49 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.263179779052734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:58:49 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:58:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:58:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:55 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:55 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances with incomplete migration  {{(pid=72793) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:58:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:00 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 04:59:00 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:07 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:59:18 user nova-compute[72793]: INFO nova.compute.manager [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attaching volume 34d715b7-8abf-47ff-860b-b0ab17218410 to /dev/vdb
Aug 17 04:59:18 user nova-compute[72793]: DEBUG os_brick.utils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50d5da5-1047-48a4-ab02-56a7711e3884]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e477ce5c16\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e860d53f-895b-4719-9ed0-4e9d10a5d406]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa6892-f839-4dac-b01b-a596716b2ab7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[394db7be-e918-40ca-8874-df16830e6466]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Running cmd (subprocess): nvme version {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] 'nvme version' failed. Not Retrying. {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] nvme not present on system {{(pid=72793) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 04:59:18 user nova-compute[72793]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 04:59:18 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc61fd-b29a-4720-966d-9ce55b3aaa7a]: (4, '') {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72793) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.lightos [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] LIGHTOS: no hostnqn found. {{(pid=72793) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG os_brick.utils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e477ce5c16', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:59:18 user nova-compute[72793]: DEBUG nova.virt.block_device [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating existing volume attachment record: 8d183841-f547-47ef-bc30-8cbb4e0ace29 {{(pid=72793) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 04:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:21 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:26 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Calling os-brick to attach iSCSI Volume {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXpVflwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:59:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:59:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:59:28 user nova-compute[72793]: INFO os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3f2538-1d64-4725-b2a6-01242554901a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 04:59:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --interface default --op new {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f564a7-5ce9-4208-bc2a-f8aaa0ce0c63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410] added\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410] added
Aug 17 04:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f772b46-e860-4db5-b90e-79f5c1692d92]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d397b0e-30e9-468e-afd2-5b46c9282342]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dXpVflwJ {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dXpVflwJ" returned: 0 in 0.021s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31610f7-78fb-48f8-83e0-4c9dac61a1a3]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dXpVflwJ'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9a9d89-4c22-4789-b1df-aaaf88033c60]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[93403e24-4941-4f7f-9c6e-8c3979cd1fc1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:59:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 04:59:28 user nova-compute[72793]:  {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:59:28 user nova-compute[72793]: WARNING os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 04:59:28 user nova-compute[72793]: 
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --login {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[48077d84-c3da-4442-929a-e46ce1bf3981]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260]
Aug 17 04:59:28 user nova-compute[72793]: Login to [iface: default, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260] successful.
Aug 17 04:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ce296c-4123-46b0-a5c5-d229599167d5]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097c2cf-f1fc-4389-95f2-61032bb65b12]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 (non-flash)
Aug 17 04:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 (non-flash)
Aug 17 04:59:28 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to 172.16.0.220:3260 {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72793) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72793) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee72ebc-f53c-4b7f-acf1-f24f04bc97c8]: (4, ('- - 0', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:28 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72793) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXpVflwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72793) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23639383933613865', 'path': '/dev/sdb'} {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639383933613865', 'path': '/dev/sdb'} {{(pid=72793) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 04:59:29 user nova-compute[72793]: DEBUG nova.objects.instance [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 04:59:30 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:59:30 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:59:30 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:59:30 user nova-compute[72793]:   <serial>34d715b7-8abf-47ff-860b-b0ab17218410</serial>
Aug 17 04:59:30 user nova-compute[72793]: </disk>
Aug 17 04:59:30 user nova-compute[72793]:  {{(pid=72793) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 04:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vda, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72793) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 04:59:30 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] No VIF found with MAC fa:16:3e:81:2c:ac, not building metadata {{(pid=72793) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 04:59:30 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-a18abeca-e8ec-4216-a0f8-14ca0929a6f0 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.797s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:59:31 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:59:32 user nova-compute[72793]: INFO nova.compute.manager [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Detaching volume 34d715b7-8abf-47ff-860b-b0ab17218410
Aug 17 04:59:32 user nova-compute[72793]: INFO nova.virt.block_device [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Attempting to driver detach volume 34d715b7-8abf-47ff-860b-b0ab17218410 from mountpoint /dev/vdb
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Attempting to detach device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config. {{(pid=72793) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:59:32 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:59:32 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:59:32 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:59:32 user nova-compute[72793]:   <serial>34d715b7-8abf-47ff-860b-b0ab17218410</serial>
Aug 17 04:59:32 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:59:32 user nova-compute[72793]: </disk>
Aug 17 04:59:32 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:59:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the persistent domain config.
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config. {{(pid=72793) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.guest [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 04:59:32 user nova-compute[72793]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 04:59:32 user nova-compute[72793]:   <source dev="/dev/sdb"/>
Aug 17 04:59:32 user nova-compute[72793]:   <target dev="vdb" bus="virtio"/>
Aug 17 04:59:32 user nova-compute[72793]:   <serial>34d715b7-8abf-47ff-860b-b0ab17218410</serial>
Aug 17 04:59:32 user nova-compute[72793]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 04:59:32 user nova-compute[72793]: </disk>
Aug 17 04:59:32 user nova-compute[72793]:  {{(pid=72793) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-7e243bd4-55cd-42a9-a92b-a93f40fc1a7e None None] Received event <DeviceRemovedEvent: 1692248372.7680595, 950b92dd-08ba-47bf-bf9b-31213692e546 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72793) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.driver [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 04:59:32 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully detached device vdb from instance 950b92dd-08ba-47bf-bf9b-31213692e546 from the live domain config.
Aug 17 04:59:32 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] calling os-brick to detach iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f98d07ed3f0>, {'target_iqns': ['iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXpVflwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 04:59:32 user nova-compute[72793]: WARNING os_brick.initiator.connectors.base [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410', 0)] {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db7383f-9e06-438f-96a0-e57b42cf5395]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d1f5b0-7fab-4fb1-b5c5-ff2cfb6d47f6]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 (non-flash)\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 (non-flash)
Aug 17 04:59:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 (non-flash)
Aug 17 04:59:32 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f98acf14af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410'): ({'sdb'}, set())}) {{(pid=72793) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Removing single pathed devices sdb {{(pid=72793) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c961f5f-01ae-4b7b-a555-5c2fe4ef33b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[662d4365-430c-465c-9ad8-3979e7d8cb3a]: (4, ('ok\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Flushing IO for device /dev/sdb {{(pid=72793) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c98ff09-c4d1-44ef-9cdb-e0b925ec9d07]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72793) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d53862-ca86-443f-97aa-28391b2456bb]: (4, ('1', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.linuxscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] SCSI volumes sdb have been removed. {{(pid=72793) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410')] {{(pid=72793) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab720847-138f-496a-bcca-837e84944209]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:32 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --logout {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef606e51-2579-4ad6-8ba8-c52c25ad16d3]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260]
Aug 17 04:59:33 user nova-compute[72793]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410, portal: 172.16.0.220,3260] successful.
Aug 17 04:59:33 user nova-compute[72793]:  stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op delete {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34d715b7-8abf-47ff-860b-b0ab17218410 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84011) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a94cbd1-22b7-4082-8f63-927869ba185b]: (4, ('', '')) {{(pid=84011) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72793) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.base [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG os_brick.initiator.connectors.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] <== disconnect_volume: return (247ms) None {{(pid=72793) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Disconnected iSCSI Volume {{(pid=72793) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG nova.objects.instance [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'flavor' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 04:59:33 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-69100c7e-bbdd-4345-acbb-0960cd0c8488 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.559s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:59:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:36 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:40 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Cleaning up deleted instances {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 04:59:40 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] There are 0 instances to clean {{(pid=72793) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 04:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:49 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 04:59:50 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:59:50 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 04:59:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.262165069580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 04:59:50 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing inventories for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating ProviderTree inventory for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Updating inventory in ProviderTree for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing aggregate associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, aggregates: None {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Refreshing trait associations for resource provider ef0e298c-f5d0-48e3-afdd-0063943a3710, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN {{(pid=72793) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 04:59:51 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 04:59:54 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:56 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 04:59:59 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 05:00:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 05:00:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 05:00:02 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:04 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:06 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:09 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:14 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:19 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:24 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:29 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:34 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:39 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:44 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:49 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:00:50 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:00:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.processutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72793) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 05:00:52 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 05:00:52 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.261314392089844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Instance 950b92dd-08ba-47bf-bf9b-31213692e546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72793) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 05:00:52 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:00:55 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:00:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:00:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 05:01:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 05:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 05:01:02 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquired lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 05:01:02 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Forcefully refreshing network info cache for instance {{(pid=72793) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 05:01:02 user nova-compute[72793]: DEBUG nova.objects.instance [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lazy-loading 'info_cache' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 05:01:03 user nova-compute[72793]: DEBUG nova.network.neutron [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [{"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 05:01:03 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Releasing lock "refresh_cache-950b92dd-08ba-47bf-bf9b-31213692e546" {{(pid=72793) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 05:01:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updated the network info_cache for instance {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 05:01:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:03 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 05:01:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:05 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:06 user nova-compute[72793]: INFO nova.compute.manager [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Terminating instance
Aug 17 05:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Start destroying the instance on the hypervisor. {{(pid=72793) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-b8a1318f-c23a-486d-b5a1-39ee425de027 req-d42c67da-de5b-44e7-89b5-f509270072a9 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-vif-unplugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b8a1318f-c23a-486d-b5a1-39ee425de027 req-d42c67da-de5b-44e7-89b5-f509270072a9 service nova] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b8a1318f-c23a-486d-b5a1-39ee425de027 req-d42c67da-de5b-44e7-89b5-f509270072a9 service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-b8a1318f-c23a-486d-b5a1-39ee425de027 req-d42c67da-de5b-44e7-89b5-f509270072a9 service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-b8a1318f-c23a-486d-b5a1-39ee425de027 req-d42c67da-de5b-44e7-89b5-f509270072a9 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] No waiting events found dispatching network-vif-unplugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 05:01:06 user nova-compute[72793]: DEBUG nova.compute.manager [req-b8a1318f-c23a-486d-b5a1-39ee425de027 req-d42c67da-de5b-44e7-89b5-f509270072a9 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-vif-unplugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 for instance with task_state deleting. {{(pid=72793) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Instance destroyed successfully.
Aug 17 05:01:07 user nova-compute[72793]: DEBUG nova.objects.instance [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lazy-loading 'resources' on Instance uuid 950b92dd-08ba-47bf-bf9b-31213692e546 {{(pid=72793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG nova.virt.libvirt.vif [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T04:53:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-815090929',display_name='tempest-SnapshotDataIntegrityTests-server-815090929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-815090929',id=52,image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/gAawtZz4la5sEhIHILDV32mJWur41ijqQmIBqcPgMTLlqZMBR0wvSBnDnMcbzJVuYkNJN5SZE0okd6BpLtuE+CHzFEBSNJhahb0qTAtHJo0NnBMFbP3sxlH9OP3AyDQ==',key_name='tempest-keypair-97245253',keypairs=<?>,launch_index=0,launched_at=2023-08-17T04:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc9456cf99514b7d9f715761450b762a',ramdisk_id='',reservation_id='r-08i3cyxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5f4b4804-03ee-46d6-a29f-d5a8a50dfc98',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1804511815',owner_user_name='tempest-SnapshotDataIntegrityTests-1804511815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T04:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9b201bc7a6b436f99d36cedf7a005ef',uuid=950b92dd-08ba-47bf-bf9b-31213692e546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Converting VIF {"id": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "address": "fa:16:3e:81:2c:ac", "network": {"id": "e79cfdb7-f7e6-49c7-87f3-d6de4bb75401", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213548015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9456cf99514b7d9f715761450b762a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa758cb-f7", "ovs_interfaceid": "9fa758cb-f75d-4f90-bfde-854a6a7af853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG nova.network.os_vif_util [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7') {{(pid=72793) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG os_vif [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7') {{(pid=72793) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fa758cb-f7, bridge=br-int, if_exists=True) {{(pid=72793) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:07 user nova-compute[72793]: INFO os_vif [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:2c:ac,bridge_name='br-int',has_traffic_filtering=True,id=9fa758cb-f75d-4f90-bfde-854a6a7af853,network=Network(e79cfdb7-f7e6-49c7-87f3-d6de4bb75401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa758cb-f7')
Aug 17 05:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Deleting instance files /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546_del
Aug 17 05:01:07 user nova-compute[72793]: INFO nova.virt.libvirt.driver [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Deletion of /opt/stack/data/nova/instances/950b92dd-08ba-47bf-bf9b-31213692e546_del complete
Aug 17 05:01:07 user nova-compute[72793]: INFO nova.compute.manager [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 05:01:07 user nova-compute[72793]: DEBUG oslo.service.loopingcall [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72793) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG nova.compute.manager [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Deallocating network for instance {{(pid=72793) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 05:01:07 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] deallocate_for_instance() {{(pid=72793) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG nova.network.neutron [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Updating instance_info_cache with network_info: [] {{(pid=72793) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 05:01:08 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Took 0.98 seconds to deallocate network for instance.
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-65c904b1-fd36-423d-932f-123411218cf9 req-1fc15017-751d-40b6-aff5-00f6872eb5b5 service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-vif-deleted-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:08 user nova-compute[72793]: INFO nova.scheduler.client.report [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Deleted allocations for instance 950b92dd-08ba-47bf-bf9b-31213692e546
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-2e0b6291-c23b-426a-a80d-d1404fe9d810 tempest-SnapshotDataIntegrityTests-1804511815 tempest-SnapshotDataIntegrityTests-1804511815-project-member] Lock "950b92dd-08ba-47bf-bf9b-31213692e546" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-f297ad80-849f-4e2d-83d0-d1d3b742240b req-52f37c8c-1318-4cf8-9751-b7b214b4b7eb service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received event network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f297ad80-849f-4e2d-83d0-d1d3b742240b req-52f37c8c-1318-4cf8-9751-b7b214b4b7eb service nova] Acquiring lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f297ad80-849f-4e2d-83d0-d1d3b742240b req-52f37c8c-1318-4cf8-9751-b7b214b4b7eb service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [req-f297ad80-849f-4e2d-83d0-d1d3b742240b req-52f37c8c-1318-4cf8-9751-b7b214b4b7eb service nova] Lock "950b92dd-08ba-47bf-bf9b-31213692e546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:08 user nova-compute[72793]: DEBUG nova.compute.manager [req-f297ad80-849f-4e2d-83d0-d1d3b742240b req-52f37c8c-1318-4cf8-9751-b7b214b4b7eb service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] No waiting events found dispatching network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 {{(pid=72793) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 05:01:08 user nova-compute[72793]: WARNING nova.compute.manager [req-f297ad80-849f-4e2d-83d0-d1d3b742240b req-52f37c8c-1318-4cf8-9751-b7b214b4b7eb service nova] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Received unexpected event network-vif-plugged-9fa758cb-f75d-4f90-bfde-854a6a7af853 for instance with vm_state deleted and task_state None.
Aug 17 05:01:11 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:01:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:22 user nova-compute[72793]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692248467.216631, 950b92dd-08ba-47bf-bf9b-31213692e546 => Stopped> {{(pid=72793) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 05:01:22 user nova-compute[72793]: INFO nova.compute.manager [-] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] VM Stopped (Lifecycle Event)
Aug 17 05:01:22 user nova-compute[72793]: DEBUG nova.compute.manager [None req-9f858c57-ad60-4e0f-83f7-2a4220259cd5 None None] [instance: 950b92dd-08ba-47bf-bf9b-31213692e546] Checking state {{(pid=72793) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 05:01:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:32 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:37 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:42 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:47 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:51 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:52 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:52 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager.update_available_resource {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Auditing locally available compute resources for user (node: user) {{(pid=72793) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 05:01:53 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 05:01:53 user nova-compute[72793]: WARNING nova.virt.libvirt.driver [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.288650512695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72793) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72793) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.compute.provider_tree [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed in ProviderTree for provider: ef0e298c-f5d0-48e3-afdd-0063943a3710 {{(pid=72793) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.scheduler.client.report [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Inventory has not changed for provider ef0e298c-f5d0-48e3-afdd-0063943a3710 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72793) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG nova.compute.resource_tracker [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Compute_service record updated for user:user {{(pid=72793) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 05:01:53 user nova-compute[72793]: DEBUG oslo_concurrency.lockutils [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72793) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72793) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72793) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:01:57 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:01:58 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:00 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:02:01 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Starting heal instance info cache {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 05:02:01 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Rebuilding the list of instances to heal {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 05:02:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Didn't find any instances for network info cache update. {{(pid=72793) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 05:02:02 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:02:02 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:02 user nova-compute[72793]: DEBUG nova.compute.manager [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72793) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 05:02:03 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:02:03 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:04 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:07 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:02:08 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:12 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:02:13 user nova-compute[72793]: DEBUG oslo_service.periodic_task [None req-7ea6f1fc-4eb3-43eb-95ec-3da9ec5bdd4f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72793) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 05:02:17 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 05:02:22 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 05:02:27 user nova-compute[72793]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72793) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}